-- Logs begin at Sat 2021-12-18 02:33:17 UTC, end at Sat 2021-12-18 03:29:37 UTC. -- Dec 18 03:04:07.158268 dv-cinder-818037-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 18 03:04:07.166572 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Dec 18 03:04:07 2021] *** Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: nodename: dv-cinder-818037-10-iscsi Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: machine: x86_64 Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: clock source: unix Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: pcre jit disabled Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: detected number of CPU cores: 4 Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: current working directory: / Dec 18 03:04:07.168549 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: detected binary path: /usr/bin/uwsgi-core Dec 18 03:04:07.169200 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: your processes number limit is 47680 Dec 18 03:04:07.169200 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: your memory page size is 4096 bytes Dec 18 03:04:07.169200 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: detected max file descriptor number: 2048 Dec 18 03:04:07.169200 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: lock engine: pthread robust mutexes Dec 18 03:04:07.169200 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: thunder lock: enabled Dec 18 03:04:07.169200 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 18 03:04:07.169200 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 18 03:04:07.215364 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: Python main interpreter initialized at 0x5634f2f819c0 Dec 18 03:04:07.215364 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: python threads support enabled Dec 18 03:04:07.215364 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: your server socket listen backlog is limited to 100 connections Dec 18 03:04:07.215364 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: your mercy for graceful operations on workers is 90 seconds Dec 18 03:04:07.215732 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: mapped 403077 bytes (393 KB) for 2 cores Dec 18 03:04:07.215808 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: *** Operational MODE: preforking *** Dec 18 03:04:07.216060 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: *** uWSGI is running in multiple interpreter mode *** Dec 18 03:04:07.216060 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: spawned uWSGI master process (pid: 101776) Dec 18 03:04:07.216249 dv-cinder-818037-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 18 03:04:07.216771 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: spawned uWSGI worker 1 (pid: 101777, cores: 1) Dec 18 03:04:07.217111 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: spawned uWSGI worker 2 (pid: 101778, cores: 1) Dec 18 03:04:07.217272 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 18 03:04:08.948813 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 03:04:08.948813 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: from cryptography.utils import int_from_bytes Dec 18 03:04:08.949484 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 03:04:08.949484 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: from cryptography.utils import int_from_bytes Dec 18 03:04:08.958474 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 03:04:08.958474 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: from cryptography.utils import int_from_bytes Dec 18 03:04:08.958965 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 03:04:08.958965 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: from cryptography.utils import int_from_bytes Dec 18 03:04:11.540587 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 03:04:11.541238 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 03:04:11.541333 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 03:04:11.541480 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 03:04:11.541921 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 03:04:11.541998 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 03:04:11.542089 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 03:04:11.542250 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 03:04:11.542361 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.542607 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.542704 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 03:04:11.542861 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 03:04:11.542948 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.543228 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.543313 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.543557 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.543650 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.543866 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.543960 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.544186 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.544291 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.544500 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.544608 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.544810 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.544894 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.545070 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.545155 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.545384 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.545482 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.545727 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-10-iscsi {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.545830 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.546048 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.546133 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.546354 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.546448 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.546661 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.546752 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-10-iscsi {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.547026 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.547165 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.547331 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.547502 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.547648 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.547896 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.547981 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.548219 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.548434 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.548544 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.549738 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.549888 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.550016 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.550163 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.550163 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.550397 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.550551 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.550684 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.550810 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.550932 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.551053 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.551173 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.551301 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.551419 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.551548 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.551661 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.551788 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.551909 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.552053 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.552175 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.552310 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-10-iscsi {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.552423 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.552550 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.552682 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.552811 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.552939 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.553067 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.553195 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-10-iscsi {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.553329 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.553443 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.553570 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.553710 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.553900 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.554029 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.554209 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.554390 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.554525 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.554706 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.554832 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.555021 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.555157 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.555345 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.555470 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.555673 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.555787 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.555986 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.556146 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.556317 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.556415 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.556642 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.556727 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.556963 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.557057 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.557286 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.557391 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.557586 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.557712 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.557912 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.558006 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.558162 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.558258 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.558468 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.558554 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.558789 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.558882 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.559106 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.559200 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.559359 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.559503 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.559660 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.559787 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.559956 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.560113 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.560236 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.560364 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.560521 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.560649 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.560827 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.560955 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.561079 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.561200 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.561382 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.561520 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.561734 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.561865 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.562041 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.562167 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.562348 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.563046 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.563230 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.563370 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.563493 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.563615 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.563774 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.563902 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.564088 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.564216 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.564425 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.564560 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.564692 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.564815 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.565005 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.565132 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.565338 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.565463 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.565640 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.565767 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.565949 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.566076 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.566285 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.566423 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.566601 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.566734 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.566906 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.567040 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.567198 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.567331 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.567529 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.567658 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.567836 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.567961 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.568140 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.568274 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.568446 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.568578 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.568764 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.568895 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.569072 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.569208 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.569381 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.569506 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.569647 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.569770 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.569940 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.570086 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.570250 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.570375 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.570565 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.570697 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.570871 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.571005 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.571172 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.571294 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.571476 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.571585 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.571778 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.571896 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.572084 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.572173 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.572390 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.572473 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.572692 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.572776 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.572990 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.573072 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.573293 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.573375 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.573602 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.573704 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.573921 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.574029 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.574223 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.574328 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.574522 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.574612 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.574823 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.574906 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.575131 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.575224 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.575433 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.575516 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.575736 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.575846 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.576034 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.576125 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.576339 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.576423 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.576650 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.576741 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.576951 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.577045 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.577255 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.577343 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.577562 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.577694 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.577888 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.577973 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.578740 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.578835 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.579061 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.579283 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.579420 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.579515 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.579732 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.579830 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.580036 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.580134 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.580355 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.580519 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.580665 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.580749 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.580974 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.581058 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.581280 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.581371 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.581581 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.581686 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.581907 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.581990 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.582213 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.582311 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.582516 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.582610 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.582819 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.582902 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.583119 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.583203 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.583417 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.583509 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.583715 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.583797 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.584016 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.584107 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.584319 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.584415 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.584622 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.584706 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.584922 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.585007 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.585225 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.585311 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.585539 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.585656 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.585884 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.585982 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.586192 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.586285 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.586499 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.586591 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.586816 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:04:11.586902 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.587153 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.587238 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.587481 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.587573 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.587799 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.587889 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.588111 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.588201 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.588426 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.588518 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.588751 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.588834 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.589061 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.589144 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.589371 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.589456 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.589703 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.589803 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.590027 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.590110 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.590338 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.590423 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.590652 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.590734 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.590964 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.591046 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.591277 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.591383 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.591595 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.591686 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.591905 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.591987 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.592224 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.592317 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.592541 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.592624 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.592861 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.592942 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.593172 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.593257 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.593490 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.593573 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.593911 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.594210 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.594309 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.594386 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.594547 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.594632 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.594861 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.594950 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.595185 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.595276 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.595501 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.595584 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.595814 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.595921 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.596134 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.596239 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.596464 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.596549 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.596778 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.596870 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.597093 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.597176 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.597411 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.597502 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.597760 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.597864 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.598079 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.598200 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.598387 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.598469 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.598694 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.598787 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.599000 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.599084 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.599312 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.599395 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.599617 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.599701 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.599925 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.600007 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.600236 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.600326 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.600547 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.600630 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.600854 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.600937 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.601173 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.601255 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.601486 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.601571 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.601821 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.601910 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.602127 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.602212 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.602438 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.602523 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.602750 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.602834 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.603312 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.603478 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.603618 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.603701 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.603930 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.604020 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.604234 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.604330 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.604541 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.604624 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.604847 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.604928 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.605153 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.605244 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.605462 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.605544 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.605792 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.605877 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.606122 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.606217 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.606412 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.606496 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.606731 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.606814 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.607041 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.607121 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.607354 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.607437 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.607670 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.607754 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.607996 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.608081 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.608298 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.608381 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.608612 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.608694 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.608935 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.609027 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.609250 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.609890 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.610100 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.610192 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.610430 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.610616 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.610760 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.610936 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.611081 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.611246 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.611389 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.611554 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.611702 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.611866 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.612009 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.612175 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.612322 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.612481 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.612629 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.612789 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.612940 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.613096 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.613249 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.613401 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.613555 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.613747 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.613889 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.614058 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.614195 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.614363 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.614502 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.614668 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.614826 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.614958 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.615139 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.615301 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.615444 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.615608 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.615750 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.615947 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.616058 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.616281 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.616404 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.616602 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.616699 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.616926 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.617042 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.617242 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.617378 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.617557 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.617726 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.617893 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.618053 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.618205 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.618370 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.618520 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.618691 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.618833 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.619005 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.619155 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.619321 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.619468 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.619637 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.619791 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.619952 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.620102 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.620278 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.620425 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.620593 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.620743 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.620917 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.621067 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.621231 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.621370 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.621557 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.621709 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.621906 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.622051 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.622238 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.622385 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.622548 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.622704 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.622867 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.623028 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.623212 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.623343 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.623549 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.623660 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.623871 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.623955 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.624197 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.624326 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.624513 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.624597 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.624830 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.624914 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.625270 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.625480 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.625745 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.625852 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.626070 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.626157 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.626387 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.626474 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.626715 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.626800 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.627035 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.627129 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.627362 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.627454 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.627790 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.627870 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.627955 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.628043 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.628288 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.628381 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.628608 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.628692 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.628917 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.629011 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.629230 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.629314 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.629552 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.629653 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.629890 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.629989 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.630202 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.630282 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.630516 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.630600 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.630822 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.630909 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.631134 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.631219 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.631443 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.631536 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.631755 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.631840 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.632064 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.632147 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.632375 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.632459 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.632678 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.632771 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.632994 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.633079 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.633301 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.633393 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.633607 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.633749 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.633931 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.634018 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.634243 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.634337 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.634554 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.634638 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.634864 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.634949 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.635172 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.635267 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.635490 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.635576 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.635791 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.635875 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.636096 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.636193 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.636419 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.636555 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.636726 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.636812 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.637030 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.637128 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.637334 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.637462 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.637653 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.637741 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.637984 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.638082 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.638293 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.638379 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.638600 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.638691 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.638905 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.638997 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.639226 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.639309 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.639536 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.639628 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.639844 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.639929 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.640154 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.640238 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.640465 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.640557 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.641314 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.641431 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.641822 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.641909 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.642144 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.642228 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.642458 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.642543 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.642771 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.642856 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.643086 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.643180 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.643397 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.643482 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.643711 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.643797 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.644021 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.644116 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.644332 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.644416 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.644643 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.644736 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.644949 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.645044 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.645260 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.645343 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.645574 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.645694 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.645913 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.646163 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.646249 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.646498 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.646583 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.646815 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.646909 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.647133 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.647378 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.647470 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.647718 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.647802 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.648039 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.648126 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.648362 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.648448 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.648689 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.648773 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.648992 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.649076 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.649302 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.649386 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.649608 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.649727 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.649934 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.650019 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.650244 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.650328 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.650549 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.650642 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.650854 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.650945 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.651157 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.651243 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.651468 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.651564 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.651772 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.651862 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.652077 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.652168 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.652383 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.652480 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.652694 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.652779 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.653005 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.653102 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.653311 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.653401 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.653655 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.653744 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.653950 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.654046 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.654264 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.654361 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.654571 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.654665 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.654873 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.654957 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.655220 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.655311 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.655477 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.655571 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.655795 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.655879 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.656099 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.656184 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.656941 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.657113 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.657253 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.657449 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.657578 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.657817 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.657922 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.658127 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.658239 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.658435 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.658572 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.658762 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.658926 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.659068 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.659212 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.659373 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.659519 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.659677 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.659846 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.659986 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.660152 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.660292 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.660459 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.660596 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.660765 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.660894 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.661077 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.661205 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.661387 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.661519 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.661716 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.661852 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.662032 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.662156 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.662347 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.662463 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.662659 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.662767 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.662979 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.663093 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.663286 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.663410 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.663598 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.663684 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.663903 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.663995 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.664220 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.664314 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.664533 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.664618 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.664832 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.664918 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.665137 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.665228 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.665436 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.665523 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.665772 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.665859 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.666076 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.666162 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.666380 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.666472 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.666683 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.666772 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.666988 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.667073 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.667293 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.667401 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.667592 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.667683 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.667895 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.667980 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.668204 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.668296 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.668505 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.668597 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.668807 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.668897 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.669112 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.669196 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.669415 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.669511 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.669741 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.669830 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.670048 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.670132 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.670360 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.670461 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.670665 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.670750 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.670965 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.671048 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.671273 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.671383 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.671791 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.671932 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.671932 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.672086 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.672222 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.672385 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.672536 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.672703 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.672844 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.673010 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.673155 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.673316 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.673462 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.673668 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.673813 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.673944 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.674121 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.674248 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.674427 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.674562 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.674732 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.674868 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.675038 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.675171 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.675343 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.675476 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.675666 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.675782 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.675977 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.676124 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.676283 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.676429 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.676590 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.676787 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.676880 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.677094 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.677224 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.677409 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.677533 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.677732 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.677919 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.678051 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.678228 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.678364 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.678545 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.678677 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.678866 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.678980 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.679181 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.679281 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.679496 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.679583 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.679812 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.679896 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.680118 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.680202 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.680434 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.680521 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.680748 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.680833 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.681061 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.681146 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.681366 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.681458 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.681698 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.681788 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.682019 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.682103 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.682332 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.682418 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.682638 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.682722 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.682948 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.683042 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.683261 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.683353 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.683569 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.683654 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.683878 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.683972 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.684186 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.684271 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.684496 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.684579 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.684808 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.684901 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.685116 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.685200 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.685427 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.685510 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.685764 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.685908 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.686073 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.686159 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.686381 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.686473 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.686690 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.686776 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.686995 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.687093 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.687301 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.687385 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.687656 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.687784 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.687962 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.688177 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.688272 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.688452 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.688547 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.688782 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.688869 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.689096 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.689189 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.689405 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.689557 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.689753 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.689897 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.690062 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.690211 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.690377 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.690516 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.690684 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.690829 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.691109 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.691203 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.691427 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.691550 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.691744 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.691829 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.692049 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.692134 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.692361 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.692467 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.692676 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.692767 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.693003 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.693094 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.693321 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.693407 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.693657 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.693747 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.693993 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.694090 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.694306 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.694391 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.694632 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.694757 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.694940 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.695036 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.695246 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.695339 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.695550 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.695635 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.695865 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.696004 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.696166 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.696250 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.696488 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.696578 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.696794 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.696891 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.697098 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.697190 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.697424 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.697508 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.697753 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.697922 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.698078 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.698240 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.698500 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.698607 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.698814 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.698908 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.699121 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.699213 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.699477 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.699570 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.699784 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.699883 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.700100 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.700191 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.700410 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.700502 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.700733 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.700825 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.701055 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.701147 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.701370 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.701470 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.701705 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.701797 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.702011 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.702102 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.702333 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.702438 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.702657 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.702754 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.702970 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.703585 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.703798 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.703902 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.704110 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.704386 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.704478 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.704720 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.704840 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.705040 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.705132 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.705363 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.705480 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.705713 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.705817 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.706028 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.706117 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.706334 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.706428 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.706647 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.706739 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.706954 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.707055 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.707260 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.707379 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.707585 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.707676 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.707892 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.707994 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.708208 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.708304 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.708512 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.708607 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.708822 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.708922 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.709129 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.709215 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.709432 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.709527 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.709774 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.709882 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.710080 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.710165 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.710385 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.710469 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.710693 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.710780 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.711016 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.711101 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.711319 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.711409 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.711638 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.711732 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.711952 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.712037 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.712261 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.712352 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.712565 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.712652 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.712870 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.712955 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.713173 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.713266 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.713493 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.713579 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.713825 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.713920 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.714134 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.714230 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.714441 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.714528 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.714776 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.714888 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.715082 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.715180 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.715406 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.715492 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.715727 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.715819 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.716044 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.716192 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.716355 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.716446 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.716676 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.716760 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.716979 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.717073 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.717282 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.717368 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.717594 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.717724 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.717916 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.718004 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.718220 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.718307 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.718522 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.718608 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.719392 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.719491 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.719704 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.719797 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.720012 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.720098 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.720318 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.720405 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.720629 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.720714 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.720934 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.721019 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.721237 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.721330 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.721541 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.721657 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.721890 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.721991 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.722194 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.722278 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.722500 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.722585 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.722811 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.722903 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.723116 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.723201 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.723428 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.723513 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.723733 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.723826 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.724062 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.724146 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.724369 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.724454 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.724689 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.724782 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.725008 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.725137 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.725324 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.725409 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.725658 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.725748 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.725975 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.726060 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.726289 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.726373 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.726606 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.726694 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.726922 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.727008 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.727237 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.727320 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.727543 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.727684 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.727859 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.728193 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.728427 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.728744 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.728744 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.728943 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.729022 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.729250 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.729336 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.729579 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.729692 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.729926 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.730013 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.730238 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.730484 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.730579 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.730823 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.730909 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.731146 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.731234 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.731460 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.731557 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.731768 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.731867 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.732078 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.732164 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.732386 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.732485 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.732699 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.732783 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.733014 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.733107 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.733334 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.733421 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.733678 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.733768 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.733996 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.734081 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.734312 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.734458 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.734651 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.734729 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.734985 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.735081 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.735307 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.735404 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.735627 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.735714 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.735947 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.736080 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.736264 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.736388 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.736601 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.736686 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.736919 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.737005 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.737226 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.737312 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.737539 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.737639 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.737879 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.737967 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.738197 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.738289 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.738508 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.738593 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.738818 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.738905 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.739132 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.739218 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.739445 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.739539 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.739761 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.739847 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.740073 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.740159 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.740390 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.740485 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.740702 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.740787 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.741015 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.741107 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.741335 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.741433 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.741676 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.741885 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.741995 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.742208 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.742306 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.742545 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.742631 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.742875 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.743116 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.743201 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.743441 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.743534 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.743776 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.743868 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.744103 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.744196 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.744419 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.744505 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.744726 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.744812 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.745038 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.745123 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.745348 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.745441 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.745676 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.745762 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.745989 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.746092 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.746298 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.746382 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.746603 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.746690 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.746907 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.747000 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.747216 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.747308 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.747525 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.747744 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.747838 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.748088 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.748186 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.748403 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.748488 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.748729 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.748953 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.749049 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.749300 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.749386 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.749663 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.749753 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.750005 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.750105 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.750317 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.750414 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.750626 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.750787 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.750943 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.751103 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.751261 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.751433 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.751568 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.751747 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.751872 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.752060 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.752184 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.752380 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.752494 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.752697 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.752791 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.753007 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.753092 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.753322 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.753407 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.753651 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.753741 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.753969 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.754057 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.754276 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.754367 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.754589 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.754681 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.754895 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.754980 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.755196 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.755281 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.755500 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.755589 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.755805 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.755890 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.756108 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.756192 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.756416 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.756512 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.756719 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.756804 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.757021 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.757282 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.757388 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.757468 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.757636 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.757736 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.757943 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.758042 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.758249 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.758335 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.758551 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.758637 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.758855 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.758952 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.759166 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.759260 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.759468 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.759553 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.759779 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.759873 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.760085 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.760170 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.760402 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.760486 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.760706 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.760792 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.761013 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.761099 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.761331 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.761417 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.761662 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.761753 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.761990 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.762214 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.762313 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.762593 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.762688 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.762916 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.763003 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.763253 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.763343 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.763591 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.763788 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.763899 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.764174 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.764259 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.764505 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.764696 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.764830 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.764927 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.765143 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.765235 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.765453 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.765547 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.766304 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.766394 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.766659 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.768974 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.769069 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.769160 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.769242 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.769329 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.769409 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.769487 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.771761 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.771851 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.771931 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.772017 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.772097 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.772175 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.774435 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.774570 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.774681 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.774768 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.774837 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.774916 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775010 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775092 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775178 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775259 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775338 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775416 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775502 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775622 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775718 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775718 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775871 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.775962 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776042 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776120 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776200 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776200 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776339 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776339 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776568 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776568 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776711 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776778 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776843 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776916 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.776997 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777075 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777154 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777244 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777332 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777412 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777490 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777490 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777490 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777490 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777830 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.777913 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778008 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778089 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778211 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778305 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778394 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778475 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778554 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778631 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778709 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778800 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.778926 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779015 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779095 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779173 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779251 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779336 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779424 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779504 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779582 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779659 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779737 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779830 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779910 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.779988 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.780074 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.780153 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.780278 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.780367 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.780587 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.780674 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.780897 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.780983 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.781282 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.782046 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.782145 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.782293 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.782443 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.782638 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.782776 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.782962 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.783087 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.783293 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.783403 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.783616 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.783711 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.783945 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.784032 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.784262 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.784353 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.784592 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.784679 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.784915 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.785000 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.785238 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.785323 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.785545 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.785660 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.785894 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.785994 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.786213 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.786306 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.786531 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.786619 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.786846 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.786932 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.787158 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.787262 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.787470 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.787556 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.787784 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.787868 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.788100 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.788199 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.788411 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.788500 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.788723 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.788809 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.789038 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.789139 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.789354 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.789439 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.789698 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.789788 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.790021 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.790109 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.790338 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.790424 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.790663 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.790747 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.790975 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.791060 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.791298 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.791391 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.791613 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.791706 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.791930 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.792018 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.792252 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.792338 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.792565 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.792650 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.792872 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.792964 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.793113 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 03:04:11.793201 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.793526 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.793881 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.794231 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.794550 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.794898 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.795235 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.795555 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.795875 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.796187 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:04:11.796434 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 03:04:11.816272 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:04:11.818492 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_db.sqlalchemy.engines [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:04:11.881721 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.context [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43b8c604-540b-400e-b8d3-fef97c564d54(cell1) {{(pid=101778) load_cells /opt/stack/nova/nova/context.py:464}} Dec 18 03:04:11.883775 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.context [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43b8c604-540b-400e-b8d3-fef97c564d54(cell1) {{(pid=101777) load_cells /opt/stack/nova/nova/context.py:464}} Dec 18 03:04:11.886012 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:04:11.887593 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:04:11.887968 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:04:11.888440 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:04:11.889563 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:04:11.890400 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:04:11.890503 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:04:11.892869 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:04:11.901435 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:04:11.903986 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:04:11.907346 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_db.sqlalchemy.engines [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:04:11.909418 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_db.sqlalchemy.engines [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:04:12.071287 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:04:12.074292 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_db.sqlalchemy.engines [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:04:12.411499 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 03:04:12.418202 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 03:04:12.418669 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: WARNING keystonemiddleware.auth_token [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 03:04:12.425569 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: WARNING keystonemiddleware.auth_token [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 03:04:12.755907 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 03:04:12.761105 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 03:04:12.766782 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5634f2f819c0 pid: 101778 (default app) Dec 18 03:04:12.768840 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:04:12.770033 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Dec 18 03:04:12.770439 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Sat Dec 18 03:04:12 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:04:12.771111 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: WARNING keystonemiddleware.auth_token [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 03:04:12.776501 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: WARNING keystonemiddleware.auth_token [None req-4b5974c8-0497-4e8a-ae9d-bd3a8a381087 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 03:04:12.781901 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5634f2f819c0 pid: 101777 (default app) Dec 18 03:05:34.956234 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:34.957354 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Dec 18 03:05:34.957857 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:05:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:05:35.392189 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-33847c6e-78ef-4d33-80d8-bd83ba693e53 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:35.422598 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-33847c6e-78ef-4d33-80d8-bd83ba693e53 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.456906 Dec 18 03:05:35.423341 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Sat Dec 18 03:05:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:05:37.843620 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:37.844634 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-4bacb4cd-5f1c-4bf3-93a1-339e9de12fd6 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Dec 18 03:05:37.845043 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:05:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:05:37.908409 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-9ad910d3-c4a9-4533-965d-0e5d4565c321 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:37.927649 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:05:37.927649 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: warnings.warn(msg) Dec 18 03:05:37.957024 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-9ad910d3-c4a9-4533-965d-0e5d4565c321 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105532 Dec 18 03:05:37.957980 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:05:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:05:38.179282 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5898b5eb-27d6-4b30-b95f-020998a55282 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:38.181659 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:05:38.181659 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: warnings.warn(msg) Dec 18 03:05:38.230124 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5898b5eb-27d6-4b30-b95f-020998a55282 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.263047 Dec 18 03:05:38.233678 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Sat Dec 18 03:05:37 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:05:40.640609 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-9ad910d3-c4a9-4533-965d-0e5d4565c321 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:40.641654 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-9ad910d3-c4a9-4533-965d-0e5d4565c321 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Dec 18 03:05:40.642045 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:05:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:05:40.766368 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-c3e6fe3c-6161-4dce-a122-e686de516b43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:40.792517 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:05:40.792517 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: warnings.warn(msg) Dec 18 03:05:40.822229 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-c3e6fe3c-6161-4dce-a122-e686de516b43 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.173172 Dec 18 03:05:40.822903 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:05:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:05:40.838002 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-2dbbad3d-65bb-418f-80b5-c407b35b814a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:40.840097 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:05:40.840097 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: warnings.warn(msg) Dec 18 03:05:40.884692 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-2dbbad3d-65bb-418f-80b5-c407b35b814a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051467 Dec 18 03:05:40.885525 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Sat Dec 18 03:05:40 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:05:43.337406 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-c3e6fe3c-6161-4dce-a122-e686de516b43 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:43.339020 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-c3e6fe3c-6161-4dce-a122-e686de516b43 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002190 Dec 18 03:05:43.339683 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:05:43 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:05:43.412000 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-9a57cf82-6beb-4264-937c-709dcd19213c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "id": "d2", "vcpus": 1}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:43.436460 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-9a57cf82-6beb-4264-937c-709dcd19213c admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088479 Dec 18 03:05:43.441794 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:05:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:05:43.452156 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-776d40e3-e157-4725-a022-fdf5251291eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:43.483003 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-776d40e3-e157-4725-a022-fdf5251291eb admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035729 Dec 18 03:05:43.483727 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Sat Dec 18 03:05:43 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:05:46.187324 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-9a57cf82-6beb-4264-937c-709dcd19213c admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:46.188462 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-9a57cf82-6beb-4264-937c-709dcd19213c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Dec 18 03:05:46.188940 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:05:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:05:46.249733 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-bad85975-e338-4fb3-aa9b-e413cafbd1d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "vcpus": 2, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:46.267930 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-bad85975-e338-4fb3-aa9b-e413cafbd1d8 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072683 Dec 18 03:05:46.268478 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:05:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:05:46.281170 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-78cff046-8562-4847-95c9-6aef43238216 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:46.302973 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-78cff046-8562-4847-95c9-6aef43238216 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026194 Dec 18 03:05:46.303700 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Sat Dec 18 03:05:46 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:05:48.741169 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-bad85975-e338-4fb3-aa9b-e413cafbd1d8 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:48.742219 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-bad85975-e338-4fb3-aa9b-e413cafbd1d8 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Dec 18 03:05:48.742623 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:05:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:05:48.806150 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-01155936-b922-4cb9-8877-9a1c071b90d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "ram": 4096, "name": "ds4G", "id": "d4", "disk": 20, "rxtx_factor": 1.0}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:48.825089 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-01155936-b922-4cb9-8877-9a1c071b90d7 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074226 Dec 18 03:05:48.825872 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:05:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:05:48.838053 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-4d287172-ae59-43ba-8a9d-552c1ac18e1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:48.862682 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-4d287172-ae59-43ba-8a9d-552c1ac18e1d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028061 Dec 18 03:05:48.877867 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Sat Dec 18 03:05:48 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:05:51.337329 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-01155936-b922-4cb9-8877-9a1c071b90d7 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:51.338460 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-01155936-b922-4cb9-8877-9a1c071b90d7 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Dec 18 03:05:51.338779 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:05:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:05:51.407323 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-45ef4970-87dc-46f5-ac2a-052e79f91cd3 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:51.435946 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-45ef4970-87dc-46f5-ac2a-052e79f91cd3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090342 Dec 18 03:05:51.436457 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Sat Dec 18 03:05:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:05:55.827884 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-01155936-b922-4cb9-8877-9a1c071b90d7 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:55.828885 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-01155936-b922-4cb9-8877-9a1c071b90d7 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 18 03:05:55.829287 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:05:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:05:55.893779 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5cf259ac-9e93-47a2-bfba-2a0f0744b3de admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "ram": 512, "swap": 0, "disk": 1}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:55.912049 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5cf259ac-9e93-47a2-bfba-2a0f0744b3de admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075942 Dec 18 03:05:55.912690 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:05:55 2021] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:05:55.925597 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-bd0eee06-f0aa-4918-bd12-e9fb972912de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:55.952460 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-bd0eee06-f0aa-4918-bd12-e9fb972912de admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030025 Dec 18 03:05:55.953668 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Sat Dec 18 03:05:55 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:05:58.374670 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5cf259ac-9e93-47a2-bfba-2a0f0744b3de admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:05:58.375688 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5cf259ac-9e93-47a2-bfba-2a0f0744b3de admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Dec 18 03:05:58.376348 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:05:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:05:58.436163 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-ffeda1ef-3516-4573-a1d6-313727c5d56a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "m1.small"}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:58.454535 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-ffeda1ef-3516-4573-a1d6-313727c5d56a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071870 Dec 18 03:05:58.455089 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:05:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:05:58.467457 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-975cb2aa-df15-4236-9114-7c03d8fca980 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:05:58.492215 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-975cb2aa-df15-4236-9114-7c03d8fca980 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028904 Dec 18 03:05:58.493157 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Sat Dec 18 03:05:58 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:06:00.936770 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-ffeda1ef-3516-4573-a1d6-313727c5d56a admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:00.938543 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-ffeda1ef-3516-4573-a1d6-313727c5d56a admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 Dec 18 03:06:00.939275 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:06:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:01.010308 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-435faa77-9f8f-4032-92ef-07bf0b06b49e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:01.031604 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-435faa77-9f8f-4032-92ef-07bf0b06b49e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085688 Dec 18 03:06:01.032156 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:06:00 2021] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:06:01.048421 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-dd583fd1-0c75-416a-afa3-cd9ee40aef3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:01.071133 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-dd583fd1-0c75-416a-afa3-cd9ee40aef3e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026256 Dec 18 03:06:01.071898 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Sat Dec 18 03:06:01 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:06:05.064890 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-435faa77-9f8f-4032-92ef-07bf0b06b49e admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:05.065919 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-435faa77-9f8f-4032-92ef-07bf0b06b49e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Dec 18 03:06:05.066487 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:06:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:05.133407 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-56f15de6-9e2e-4299-85ec-aca9758805f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "id": "4", "ram": 8192}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:05.152670 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-56f15de6-9e2e-4299-85ec-aca9758805f6 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079247 Dec 18 03:06:05.153876 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:06:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:06:05.166068 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-6e7ac67e-14d3-419c-8eea-a42d6ba082d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:05.192441 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-6e7ac67e-14d3-419c-8eea-a42d6ba082d2 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030006 Dec 18 03:06:05.193296 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Sat Dec 18 03:06:05 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:06:07.616030 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-56f15de6-9e2e-4299-85ec-aca9758805f6 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:07.617708 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-56f15de6-9e2e-4299-85ec-aca9758805f6 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Dec 18 03:06:07.621910 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:06:07 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:07.678582 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-aeb727ef-d3ed-40f4-a353-7c3cb0c7f527 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:07.696684 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-aeb727ef-d3ed-40f4-a353-7c3cb0c7f527 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071848 Dec 18 03:06:07.697233 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Sat Dec 18 03:06:07 2021] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:06:07.709444 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-60138d96-1fd0-4728-af34-dbae66b6dad5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:07.736346 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-60138d96-1fd0-4728-af34-dbae66b6dad5 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030720 Dec 18 03:06:07.736936 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Sat Dec 18 03:06:07 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:06:26.612824 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-aeb727ef-d3ed-40f4-a353-7c3cb0c7f527 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:26.613863 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-aeb727ef-d3ed-40f4-a353-7c3cb0c7f527 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Dec 18 03:06:26.614264 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:06:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:26.671061 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-da4028cc-9a68-4a05-aa58-8de32ace13b2 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:26.687883 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-da4028cc-9a68-4a05-aa58-8de32ace13b2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066698 Dec 18 03:06:26.688408 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Sat Dec 18 03:06:26 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:06:28.285467 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-aeb727ef-d3ed-40f4-a353-7c3cb0c7f527 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:28.286500 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-aeb727ef-d3ed-40f4-a353-7c3cb0c7f527 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Dec 18 03:06:28.287160 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:06:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:28.477582 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-248eaf80-32b3-41c0-9589-0c0a6d7a49e3 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:28.483510 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.wsgi [None req-248eaf80-32b3-41c0-9589-0c0a6d7a49e3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 18 03:06:28.484081 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-248eaf80-32b3-41c0-9589-0c0a6d7a49e3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:06:28.484882 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-248eaf80-32b3-41c0-9589-0c0a6d7a49e3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058189 Dec 18 03:06:28.485392 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Sat Dec 18 03:06:28 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 03:06:28.495730 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-cd5d8e03-f5ae-4995-8c67-eed44b61465c admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:28.516197 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-cd5d8e03-f5ae-4995-8c67-eed44b61465c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024630 Dec 18 03:06:28.516725 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Sat Dec 18 03:06:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:06:28.526787 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-9b08237a-202d-401e-a6ba-c3da62f632b1 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:28.547672 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-9b08237a-202d-401e-a6ba-c3da62f632b1 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024503 Dec 18 03:06:28.548216 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Sat Dec 18 03:06:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:06:28.558303 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f9646932-868d-499e-84cb-37e1e0bbeb6a admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:28.563627 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-f9646932-868d-499e-84cb-37e1e0bbeb6a admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 18 03:06:28.564187 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f9646932-868d-499e-84cb-37e1e0bbeb6a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:06:28.564968 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-f9646932-868d-499e-84cb-37e1e0bbeb6a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010639 Dec 18 03:06:28.565453 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Sat Dec 18 03:06:28 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 18 03:06:30.055409 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-9b08237a-202d-401e-a6ba-c3da62f632b1 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:30.056419 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-9b08237a-202d-401e-a6ba-c3da62f632b1 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Dec 18 03:06:30.056815 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:06:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:30.249258 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-dd2e56a1-ad90-4317-88d8-2363f811ed05 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:30.254410 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-dd2e56a1-ad90-4317-88d8-2363f811ed05 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 18 03:06:30.254975 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-dd2e56a1-ad90-4317-88d8-2363f811ed05 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:06:30.255759 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-dd2e56a1-ad90-4317-88d8-2363f811ed05 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059343 Dec 18 03:06:30.256265 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Sat Dec 18 03:06:30 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 03:06:30.265985 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-d11a9d39-a903-452f-b7c6-808b430b316d admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:30.279603 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-d11a9d39-a903-452f-b7c6-808b430b316d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017174 Dec 18 03:06:30.280122 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Sat Dec 18 03:06:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:06:30.289652 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-9b4603dc-6f7f-496f-8b46-9eeda3e62f00 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:30.303519 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-9b4603dc-6f7f-496f-8b46-9eeda3e62f00 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017241 Dec 18 03:06:30.304026 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Sat Dec 18 03:06:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:06:30.313882 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-a29477a0-a530-49cb-81f1-6e7f942d4666 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:30.318972 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.wsgi [None req-a29477a0-a530-49cb-81f1-6e7f942d4666 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 18 03:06:30.319532 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-a29477a0-a530-49cb-81f1-6e7f942d4666 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:06:30.320311 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-a29477a0-a530-49cb-81f1-6e7f942d4666 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009903 Dec 18 03:06:30.320794 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Sat Dec 18 03:06:30 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 18 03:06:31.802316 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-9b4603dc-6f7f-496f-8b46-9eeda3e62f00 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:31.803334 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-9b4603dc-6f7f-496f-8b46-9eeda3e62f00 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Dec 18 03:06:31.803730 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:06:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:31.996131 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-96ffc0cd-0b1b-4efc-8678-1c452b15bde4 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:32.001355 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.wsgi [None req-96ffc0cd-0b1b-4efc-8678-1c452b15bde4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 18 03:06:32.001957 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-96ffc0cd-0b1b-4efc-8678-1c452b15bde4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:06:32.002748 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-96ffc0cd-0b1b-4efc-8678-1c452b15bde4 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057997 Dec 18 03:06:32.003258 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Sat Dec 18 03:06:31 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 03:06:32.013070 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-6dad0965-d2a3-452f-847d-35e6496a9d3d admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:32.026206 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-6dad0965-d2a3-452f-847d-35e6496a9d3d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016621 Dec 18 03:06:32.026816 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Sat Dec 18 03:06:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:06:32.038017 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:32.051424 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018362 Dec 18 03:06:32.051957 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Sat Dec 18 03:06:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:06:32.062116 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-26b27473-ce38-4afa-b9c1-7b0baf462cac admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:32.067210 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-26b27473-ce38-4afa-b9c1-7b0baf462cac admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 18 03:06:32.067762 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-26b27473-ce38-4afa-b9c1-7b0baf462cac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:06:32.068537 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-26b27473-ce38-4afa-b9c1-7b0baf462cac admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009921 Dec 18 03:06:32.069026 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Sat Dec 18 03:06:32 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 18 03:06:33.553161 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:33.554210 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 18 03:06:33.554611 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:06:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:33.744418 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-e2668cd2-66e5-4ece-b71d-a542c70aac55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:33.764931 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-e2668cd2-66e5-4ece-b71d-a542c70aac55 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071470 Dec 18 03:06:33.765577 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Sat Dec 18 03:06:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:06:35.259623 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:35.261190 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Dec 18 03:06:35.261190 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:06:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:35.454084 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-2e938ebc-d637-473e-9b0b-b0d6d8888fdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:35.468661 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-2e938ebc-d637-473e-9b0b-b0d6d8888fdb admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067766 Dec 18 03:06:35.469135 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Sat Dec 18 03:06:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:06:36.948733 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:36.949776 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Dec 18 03:06:36.950173 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:06:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:37.146985 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-3e8e864c-5055-4f9b-9199-dcae29863f77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:37.164454 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-3e8e864c-5055-4f9b-9199-dcae29863f77 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069209 Dec 18 03:06:37.164926 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Sat Dec 18 03:06:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:06:38.655396 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:38.656335 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Dec 18 03:06:38.656727 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:06:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:38.845427 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-19f2802a-ac51-43da-ac95-c611b2c0e725 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:06:38.863250 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-19f2802a-ac51-43da-ac95-c611b2c0e725 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067667 Dec 18 03:06:38.863775 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Sat Dec 18 03:06:38 2021] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:06:40.342484 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:40.343489 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Dec 18 03:06:40.343885 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:06:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:06:40.538697 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-555808a9-d168-4f00-b2d3-b97848cb8806 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:06:40.557825 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-555808a9-d168-4f00-b2d3-b97848cb8806 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068898 Dec 18 03:06:40.558287 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Sat Dec 18 03:06:40 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:07:28.035160 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:07:28.036193 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-a7f39f11-18e0-4f2e-bf02-b81029084975 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Dec 18 03:07:28.036590 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Sat Dec 18 03:07:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:07:28.094759 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-99061821-3b5c-4810-8c6a-269f9ab27d00 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:07:28.114239 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-99061821-3b5c-4810-8c6a-269f9ab27d00 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071180 Dec 18 03:07:28.114761 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Sat Dec 18 03:07:28 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:07:28.137470 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-9597f567-42e0-483e-bc8c-73b4ad1d02c4 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:07:28.145029 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-9597f567-42e0-483e-bc8c-73b4ad1d02c4 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011785 Dec 18 03:07:28.145544 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Sat Dec 18 03:07:28 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:07:28.157186 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-c263d04e-3cf3-4266-b928-b92ebc0bfc8a admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:07:28.164594 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-c263d04e-3cf3-4266-b928-b92ebc0bfc8a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010909 Dec 18 03:07:28.165610 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Sat Dec 18 03:07:28 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:07:28.176719 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-fcfeda2d-795d-4f7c-a671-94b61cea4136 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:07:28.184796 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-fcfeda2d-795d-4f7c-a671-94b61cea4136 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011470 Dec 18 03:07:28.185311 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Sat Dec 18 03:07:28 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:07:28.196577 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:07:28.203948 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010782 Dec 18 03:07:28.204450 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Sat Dec 18 03:07:28 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:08:50.890494 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-2863a1bb-85fc-4c35-a4b7-3467fabed9b3 tempest-verify_tempest_config-1885561122 tempest-verify_tempest_config-1885561122-project] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:08:50.892553 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-2863a1bb-85fc-4c35-a4b7-3467fabed9b3 tempest-verify_tempest_config-1885561122 tempest-verify_tempest_config-1885561122-project] 10.222.0.24 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104929 Dec 18 03:08:50.893087 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 34/69] 10.222.0.24 () {58 vars in 1133 bytes} [Sat Dec 18 03:08:50 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:10:17.374948 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:10:17.375950 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Dec 18 03:10:17.376492 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 36/70] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:10:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:10:17.625506 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-eb56d871-c908-4aba-b022-9f001caafa31 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:10:17.626723 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:10:17.626723 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: warnings.warn(msg) Dec 18 03:10:17.628330 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-eb56d871-c908-4aba-b022-9f001caafa31 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:10:17.628806 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-eb56d871-c908-4aba-b022-9f001caafa31 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:10:17.629630 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-eb56d871-c908-4aba-b022-9f001caafa31 admin admin] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:10:17.630071 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-eb56d871-c908-4aba-b022-9f001caafa31 admin admin] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:10:17.662481 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-eb56d871-c908-4aba-b022-9f001caafa31 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.145451 Dec 18 03:10:17.663035 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 35/71] 10.222.0.24 () {60 vars in 1193 bytes} [Sat Dec 18 03:10:17 2021] GET /compute/v2.1/os-services => generated 794 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:10:19.160324 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:10:19.161330 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Dec 18 03:10:19.161749 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 37/72] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:10:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:10:19.353352 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-75eff1b2-50c4-437a-b8a5-8cd3ccec4ff1 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:10:19.354786 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:10:19.354786 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: warnings.warn(msg) Dec 18 03:10:19.356298 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-75eff1b2-50c4-437a-b8a5-8cd3ccec4ff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:10:19.356740 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-75eff1b2-50c4-437a-b8a5-8cd3ccec4ff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:10:19.357545 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-75eff1b2-50c4-437a-b8a5-8cd3ccec4ff1 admin admin] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:10:19.358000 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-75eff1b2-50c4-437a-b8a5-8cd3ccec4ff1 admin admin] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:10:19.376856 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-75eff1b2-50c4-437a-b8a5-8cd3ccec4ff1 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074597 Dec 18 03:10:19.377330 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 36/73] 10.222.0.24 () {60 vars in 1193 bytes} [Sat Dec 18 03:10:19 2021] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:10:31.281981 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:10:31.282985 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Dec 18 03:10:31.283375 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 38/74] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:10:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:10:31.476207 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-113c897f-c616-4057-bca3-af0c1199f764 admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:10:31.477485 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:10:31.477485 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: warnings.warn(msg) Dec 18 03:10:31.479844 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-113c897f-c616-4057-bca3-af0c1199f764 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:10:31.480416 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-113c897f-c616-4057-bca3-af0c1199f764 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:10:31.481078 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-113c897f-c616-4057-bca3-af0c1199f764 admin admin] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:10:31.481603 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-113c897f-c616-4057-bca3-af0c1199f764 admin admin] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:10:31.508004 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-113c897f-c616-4057-bca3-af0c1199f764 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082769 Dec 18 03:10:31.508493 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 37/75] 10.222.0.24 () {60 vars in 1193 bytes} [Sat Dec 18 03:10:31 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:10:32.990891 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:10:32.991904 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-2d0b9a31-98f4-4a49-87ba-26386e630fa4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Dec 18 03:10:32.992312 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 39/76] 10.222.0.24 () {56 vars in 1074 bytes} [Sat Dec 18 03:10:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:10:33.185578 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG nova.api.openstack.wsgi [None req-5ca3e29f-7087-4607-bf35-c918c607c46e admin admin] Calling method '>' {{(pid=101777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:10:33.186771 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:10:33.186771 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: warnings.warn(msg) Dec 18 03:10:33.188303 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-5ca3e29f-7087-4607-bf35-c918c607c46e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:10:33.188747 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-5ca3e29f-7087-4607-bf35-c918c607c46e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:10:33.189554 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-5ca3e29f-7087-4607-bf35-c918c607c46e admin admin] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:10:33.190040 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: DEBUG oslo_concurrency.lockutils [None req-5ca3e29f-7087-4607-bf35-c918c607c46e admin admin] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:10:33.211220 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: INFO nova.api.openstack.requestlog [None req-5ca3e29f-7087-4607-bf35-c918c607c46e admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076942 Dec 18 03:10:33.211692 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: [pid: 101777|app: 0|req: 38/77] 10.222.0.24 () {60 vars in 1193 bytes} [Sat Dec 18 03:10:33 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:11:28.226997 dv-cinder-818037-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 18 03:11:28.227530 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: Sat Dec 18 03:11:28 2021 - graceful shutdown triggered... Dec 18 03:11:28.227978 dv-cinder-818037-10-iscsi devstack@n-api.service[101777]: Gracefully killing worker 1 (pid: 101777)... Dec 18 03:11:28.228545 dv-cinder-818037-10-iscsi devstack@n-api.service[101778]: Gracefully killing worker 2 (pid: 101778)... Dec 18 03:11:29.228471 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: worker 1 buried after 1 seconds Dec 18 03:11:29.229031 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: worker 2 buried after 1 seconds Dec 18 03:11:29.229031 dv-cinder-818037-10-iscsi devstack@n-api.service[101776]: goodbye to uWSGI. Dec 18 03:11:29.230291 dv-cinder-818037-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 18 03:11:29.230858 dv-cinder-818037-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 18 03:11:29.234234 dv-cinder-818037-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 18 03:11:29.243321 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Dec 18 03:11:29 2021] *** Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: nodename: dv-cinder-818037-10-iscsi Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: machine: x86_64 Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: clock source: unix Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: pcre jit disabled Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: detected number of CPU cores: 4 Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: current working directory: / Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: detected binary path: /usr/bin/uwsgi-core Dec 18 03:11:29.245283 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: your processes number limit is 47680 Dec 18 03:11:29.246183 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: your memory page size is 4096 bytes Dec 18 03:11:29.246183 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: detected max file descriptor number: 2048 Dec 18 03:11:29.246183 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: lock engine: pthread robust mutexes Dec 18 03:11:29.246183 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: thunder lock: enabled Dec 18 03:11:29.246183 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 18 03:11:29.246183 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 18 03:11:29.290447 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: Python main interpreter initialized at 0x55f27dbc49c0 Dec 18 03:11:29.290447 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: python threads support enabled Dec 18 03:11:29.290447 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: your server socket listen backlog is limited to 100 connections Dec 18 03:11:29.290447 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: your mercy for graceful operations on workers is 90 seconds Dec 18 03:11:29.290932 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: mapped 403077 bytes (393 KB) for 2 cores Dec 18 03:11:29.290932 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: *** Operational MODE: preforking *** Dec 18 03:11:29.296449 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: *** uWSGI is running in multiple interpreter mode *** Dec 18 03:11:29.296449 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: spawned uWSGI master process (pid: 115981) Dec 18 03:11:29.296449 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: spawned uWSGI worker 1 (pid: 116000, cores: 1) Dec 18 03:11:29.296449 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: spawned uWSGI worker 2 (pid: 116001, cores: 1) Dec 18 03:11:29.296449 dv-cinder-818037-10-iscsi devstack@n-api.service[115981]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 18 03:11:29.291363 dv-cinder-818037-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 18 03:11:31.195947 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 03:11:31.195947 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: from cryptography.utils import int_from_bytes Dec 18 03:11:31.196635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 03:11:31.196635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: from cryptography.utils import int_from_bytes Dec 18 03:11:31.196777 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 03:11:31.196777 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: from cryptography.utils import int_from_bytes Dec 18 03:11:31.197244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 03:11:31.197244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: from cryptography.utils import int_from_bytes Dec 18 03:11:33.622260 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 03:11:33.622886 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 03:11:33.622996 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 03:11:33.623353 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 03:11:33.623476 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 03:11:33.623838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 03:11:33.623921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 03:11:33.624004 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.624208 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 03:11:33.624318 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.624521 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 03:11:33.624620 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.624779 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 03:11:33.624940 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.625177 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.625295 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.625515 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.625744 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.625888 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.625988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.626191 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.626298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.626521 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.626625 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.626786 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.626884 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.627095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.627212 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.627424 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-10-iscsi {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.627524 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.627756 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.627869 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.628025 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.628172 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.628351 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.628523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.628673 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.628826 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-10-iscsi {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.629015 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.629176 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.629343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.629492 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.629740 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.629909 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.630056 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.630203 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.630381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.630828 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.631147 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.631538 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.631744 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.631949 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.632150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.632365 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.632577 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.632795 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.632996 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.633200 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.633429 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.633669 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.633888 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.634098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.634300 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.634515 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.634731 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.634731 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.635143 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-10-iscsi {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.635359 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.635570 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.635772 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.636002 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.636221 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.636422 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.636637 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.636819 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.637324 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-10-iscsi {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.637948 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.637948 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.639130 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.639304 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.640179 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.640179 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.640477 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.640477 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.640823 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.640988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.640988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.640988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.641416 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.642137 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.642308 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.642450 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.642603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.642790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.642981 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.643134 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.643283 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.643422 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.643573 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.643713 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.643852 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.643991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.644136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.644276 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.644276 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.644560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.644560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.644831 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.644988 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.645139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.645288 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.645427 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.645427 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.645738 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.645884 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.646048 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.646194 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.646343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.646482 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.646645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.646793 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.646939 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.647079 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.647217 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.647364 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.647502 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.647649 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.647787 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.647938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.648084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.648084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.648369 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.648369 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.648637 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.648777 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.648921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.649067 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.649219 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.649366 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.649504 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.649504 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.649818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.649965 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.650118 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.650278 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.650423 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.650562 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.650710 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.650848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.650998 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.651137 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.651283 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.651428 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.651572 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.652343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.652501 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.652771 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.652964 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.653111 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.653396 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.653547 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.653720 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.653720 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.653985 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.653985 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.654315 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.654552 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.654703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.654703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.654994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.654994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.655268 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.655417 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.655576 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.655576 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.655848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.655999 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.656152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.656304 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.656444 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.656589 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.656728 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.656877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.657029 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.657169 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.657307 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.657454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.657600 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.657804 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.657954 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.658100 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.658239 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.658377 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.658524 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.659240 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.659387 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.659526 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.659678 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.659825 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.659971 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.660117 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.660255 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.660627 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.660895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.661155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.661318 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.661479 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.661652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.662517 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.662690 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.662840 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.662988 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.663135 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.663283 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.663435 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.663583 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.663730 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.663876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.664017 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.664168 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.664320 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.664468 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.664618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.664770 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.664919 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.665058 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.665205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.665352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.665498 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.665694 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.665854 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.666006 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.666169 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.666310 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.666462 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.666609 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.666756 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.666914 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.667069 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.667210 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.667348 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.667486 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.667625 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.667778 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.667937 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.668078 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.668224 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.668937 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.669245 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.669405 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.669547 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.669709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.669852 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.670001 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.670155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.670294 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.670434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.670591 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.670733 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.670879 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.671035 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.671177 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.671324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.671464 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.671602 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.671751 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.671922 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.672736 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.672887 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.673036 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.673191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.673352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.673874 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.674031 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.674184 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.674317 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.674949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.675091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.675193 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.675280 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.675362 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.675451 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.675535 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.675631 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.675721 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.675805 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.675893 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.675987 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.676070 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.676159 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.676249 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.676340 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 03:11:33.676430 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.676430 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.676655 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.676745 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.676837 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.676926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677009 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677090 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677182 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677266 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677346 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677428 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677524 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677769 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677857 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.677938 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678019 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678100 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678190 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678280 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678370 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678460 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678555 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678647 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678730 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678811 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678909 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.678993 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679074 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679154 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679245 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679340 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679340 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679501 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679591 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679673 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679761 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679856 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.679939 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680107 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680212 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680388 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680482 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680566 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680653 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680897 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.680980 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681158 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681241 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681330 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681419 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681501 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681590 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681700 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681786 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681881 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.681964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.682045 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.682125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.682205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.682288 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.682651 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.682931 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683021 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683104 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683194 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683283 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683379 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683462 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683550 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683633 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683722 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.683822 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.684014 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.684624 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.684710 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.684792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.684874 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.684969 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685061 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685233 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685322 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685406 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685495 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685585 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685687 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685771 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685853 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.685948 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686047 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686232 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686322 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686406 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686495 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686585 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686674 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686762 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.686849 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.687033 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.687133 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.687352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.687442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.687664 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.687761 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.687997 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.688096 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.688313 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.688407 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.688625 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.688715 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.688955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.689057 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.689269 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.689358 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.689577 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.689733 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.689921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.690013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.690238 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.690328 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.690554 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.690650 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.690867 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.690958 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.691182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.691271 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.691489 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.691586 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.691797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.691895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.692107 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.692196 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.692419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.692531 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.692825 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.693114 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.693207 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.693290 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.693379 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.693476 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.693603 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.693727 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.693933 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.694023 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.694260 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.694358 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.694571 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.694667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.694876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.694965 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.695183 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.695286 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.695503 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.695694 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.695810 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.695898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.696121 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.696225 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.696430 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.696583 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.696720 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.696876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.697080 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.697200 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.697367 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.697521 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.697663 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.697883 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.698049 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.698207 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.698323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.698523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.698648 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.698868 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.699001 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.699155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.699271 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.699472 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.699669 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.699842 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.699972 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.700161 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.700279 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.700489 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.700606 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.700804 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.700928 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.701140 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.701263 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.701454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.701571 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.701826 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.701939 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.702182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.702307 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.702425 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.702541 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.702917 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.703072 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.703368 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.703552 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.703667 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.703775 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.703964 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.704060 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.704154 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.704244 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.704391 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.704547 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.704689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.704780 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.704966 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.705056 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.705281 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.705378 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.705599 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.705729 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.705958 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.706056 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.706274 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.706379 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.706597 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.706694 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.706910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.707000 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.707230 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.707331 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.707540 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.707630 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.707855 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.707943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.708159 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.708259 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.708478 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.708568 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.708805 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.708903 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.709125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.709223 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.709440 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.709529 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.709779 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.709883 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.710101 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.710191 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.710416 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.710513 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.710729 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.710825 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.711040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.711130 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.711347 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.711436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.711657 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.711747 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.711971 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.712109 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.712289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.712386 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.712677 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.712847 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.713123 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.713217 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.713299 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.713450 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.713560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.714275 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.714399 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.714488 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.714571 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.714652 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.714733 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.714829 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.714920 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.715012 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.715095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.715333 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.715425 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.715710 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.715807 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.716023 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.716139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.716343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.716471 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.716659 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.716782 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.716971 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.717094 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.717280 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.717428 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.717596 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.717772 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.717948 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.718085 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.718267 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.718399 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.718599 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.718710 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.718928 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.719061 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.719239 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.719375 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.719550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.719684 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.719882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.720042 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.720200 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.720364 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.720513 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.720615 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.720824 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.720922 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.721136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.721234 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.721489 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.721580 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.721831 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.721925 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.722143 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.722234 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.722464 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.722554 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.722779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.722875 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.723097 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.723242 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.723404 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.723498 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.723722 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.723826 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.724032 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.724195 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.724331 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.724469 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.724646 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.724795 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.724960 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.725093 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.725267 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.725409 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.725564 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.725746 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.725894 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.726027 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.726213 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.726493 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.726640 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.726859 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.727004 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.727140 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.727277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.727443 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.727591 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.727741 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.727841 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.728056 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.728197 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.728378 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.728546 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.728709 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.729025 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.729165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.729331 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.729735 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.729922 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.730067 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.730233 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.730379 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.730543 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.730682 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.731509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.731649 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.731796 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.731888 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.732106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.732258 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.732427 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.732575 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.732728 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.732866 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.733038 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.733154 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.733418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.733504 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.733660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.733773 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.733982 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.734122 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.734295 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.734400 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.734601 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.734702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.734983 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.735093 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.735259 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.735439 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.735568 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.735658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.735878 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.735975 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.736181 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.736270 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.736488 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.736585 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.736793 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.736896 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.737126 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.737216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.737432 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.737521 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.737764 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.737867 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.738097 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.738195 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.738413 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.738511 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.738723 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.738830 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.739031 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.739121 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.739340 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.739438 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.739661 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.739758 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.739970 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.740074 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.740278 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.740377 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.740588 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.740687 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.740899 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.740989 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.741204 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.741301 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.741522 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.741670 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.741862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.741953 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.742176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.742273 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.742485 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.742581 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.742790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.742886 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.743220 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.743384 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.743384 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.743716 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.743806 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.743888 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.744049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.744395 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.744506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.744632 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.744721 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.744811 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.744894 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.744986 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.745178 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.745268 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.745483 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.745581 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.745844 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.745961 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.746145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.746237 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.746508 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.747155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.747299 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.747508 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.747691 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.747820 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.748008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.748129 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.748323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.748442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.748634 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.748754 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.748948 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.749045 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.749258 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.749376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.749580 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.749812 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.749901 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.750013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.750210 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.750308 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.750520 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.750609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.750836 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.750933 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.751168 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.751297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.751462 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.751592 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.751792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.751916 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.752108 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.752209 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.752419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.752515 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.752729 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.752830 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.753034 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.753122 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.753343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.753443 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.753672 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.753830 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.753986 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.754085 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.754294 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.754417 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.754599 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.754770 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.754933 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.755028 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.755198 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.755296 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.755505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.755603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.755821 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.755908 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.756130 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.756297 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.756438 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.756555 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.756746 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.756835 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.757093 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.757200 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.757355 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.757446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.757686 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.757790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.757998 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.758102 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.758330 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.758428 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.758645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.758736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.758956 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.759053 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.759267 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.759359 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.759576 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.759665 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.759889 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.760061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.760199 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.760294 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.760518 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.760608 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.760834 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.760936 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.761149 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.761239 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.761464 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.761560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.761798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.761904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.762209 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.762309 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.762530 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.762653 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.762847 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.762970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.763175 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.763294 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.763505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.763615 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.763845 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.763991 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.764179 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.764366 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.764511 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.764604 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.764763 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.764889 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.765071 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.765183 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.765383 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.765480 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.765718 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.765815 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.766034 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.766140 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.766352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.766458 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.766669 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.766762 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.766983 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.767075 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.767299 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.767390 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.767609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.767710 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.767923 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.768022 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.768231 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.768331 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.768543 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.768636 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.768860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.768951 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.769174 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.769277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.769486 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.769577 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.769826 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.769938 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.770136 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.770252 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.770452 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.770552 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.770759 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.770860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.771070 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.771185 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.771409 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.771512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.771726 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.771828 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.772040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.772149 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.772358 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.772460 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.772672 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.772780 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.772991 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.773092 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.773303 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.773411 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.773701 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.773803 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.774050 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.774156 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.774370 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.774520 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.774686 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.774805 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.775001 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.775099 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.775311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.775408 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.775620 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.775722 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.775937 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.776042 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.776248 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.776353 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.776562 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.776658 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.776870 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.776981 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.777179 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.777303 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.777509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.777662 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.777964 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.778069 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.778295 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.778434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.778615 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.778862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.778959 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.779179 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.779269 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.779490 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.779591 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.779849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.779945 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.780184 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.780276 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.780498 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.780602 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.780829 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.780926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.781157 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.781245 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.781487 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.781588 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.781827 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.781918 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.782146 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.782303 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.782459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.782634 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.782788 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.782940 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.783117 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.783275 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.783433 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.783628 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.783773 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.783948 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.784052 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.784264 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.784467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.784602 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.784718 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.784893 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.784990 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.785226 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.785328 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.785560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.785819 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.785922 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.786157 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.786260 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.786475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.786565 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.786800 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.786890 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.787132 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.787229 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.787443 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.787541 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.787753 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.787841 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.788066 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.788206 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.788376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.788540 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.788686 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.788859 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.789014 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.789186 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.789326 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.789521 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.789661 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.789859 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.789980 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.790176 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.790293 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.790494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.790591 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.790808 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.790898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.791122 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.791218 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.791454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.791544 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.791768 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.791858 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.792087 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.792176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.792405 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.792503 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.792723 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.792813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.793034 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.793134 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.793929 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.794052 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.794262 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.794401 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.794660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.794770 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.794985 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.795140 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.795297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.795389 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.795631 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.795719 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.795943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.796045 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.796268 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.796359 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.796599 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.796686 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.796920 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.797011 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.797231 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.797325 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.797543 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.797652 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.797909 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.798008 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.798229 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.798320 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.798551 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.798648 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.798874 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.799001 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.799180 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.799268 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.799489 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.799578 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.799802 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.799891 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.800112 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.800202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.800422 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.800519 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.800732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.800830 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.801045 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.801134 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.801352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.801449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.801679 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.801773 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.801988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.802086 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.802323 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.802420 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.802631 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.802727 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.802940 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.803035 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.803252 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.803354 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.803556 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.803643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.803863 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.803988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.804168 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.804259 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.804480 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.804633 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.804811 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.804945 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.805123 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.805254 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.805453 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.805544 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.805791 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.805882 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.806106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.806204 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.806417 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.806550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.806746 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.806837 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.807065 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.807157 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.807384 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.807482 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.807703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.807801 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.808020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.808117 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.808339 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.808429 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.808658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.808759 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.809030 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.809791 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.809945 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.810082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.810231 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.810370 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.810505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.810639 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.810759 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.810920 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.811243 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.811345 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.811568 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.811659 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.811895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.811990 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.812218 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.812314 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.812533 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.812622 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.812853 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.812940 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.813168 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.813264 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.813482 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.813570 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.813971 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.814124 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.814232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.814368 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.814467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.814689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.814949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.815089 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.815181 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.815323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.815414 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.815646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.815743 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.815968 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.816066 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.816285 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.816376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.816601 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.816691 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.816920 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.817040 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.817236 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.817431 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.817572 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.817707 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.817911 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.818004 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.818231 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.818324 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.818550 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.818652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.818868 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.818970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.819183 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.819275 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.819497 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.819590 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.819815 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.819907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.820131 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.820222 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.820444 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.820549 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.820757 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.820849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.821073 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.821176 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.821390 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.821489 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.821732 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.821828 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.822057 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.822160 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.822376 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.822469 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.822695 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.822789 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.823012 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.823114 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.823326 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.823418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.823643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.823847 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.823947 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.824172 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.824286 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.824526 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.824658 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.824923 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.825106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.825269 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.825415 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.825574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.825760 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.825910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.826069 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.826209 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.826356 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.826495 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.826729 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.826869 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.827059 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.827202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.827366 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.827463 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.827676 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.827779 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.828003 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.828107 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.828319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.828409 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.828630 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.828732 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.828953 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.829043 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.829264 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.829353 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.829578 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.829824 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.829916 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.830175 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.830266 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.830496 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.830585 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.830828 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.830925 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.831144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.831232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.831460 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.831649 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.831770 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.831860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.832084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.832191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.832401 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.832627 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.832720 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.832987 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.833077 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.833316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.833405 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.833653 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.833748 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.833957 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.834049 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.834271 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.834362 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.834583 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.834675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.834892 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.835028 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.835238 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.835394 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.835512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.835603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.835843 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.835939 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.836148 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.836247 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.836459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.836549 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.836766 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.836869 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.837083 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.837190 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.837390 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.837484 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.837722 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.837828 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.838032 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.838136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.838340 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.838440 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.838654 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.838758 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.838962 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.839088 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.839273 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.839391 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.839578 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.839675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.839894 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.839993 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.840250 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.840387 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.840561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.840667 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.840874 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.840967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.841183 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.841273 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.841501 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.841603 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.841838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.841937 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.842153 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.842244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.842464 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.842562 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.842781 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.842878 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.843091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.843183 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.843403 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.843509 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.843713 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.843809 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.844045 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.844137 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.844355 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.844581 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.844679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.844970 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.845061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.845296 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.845434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.845626 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.845719 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.845955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.846100 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.846274 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.846380 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.846587 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.846711 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.846895 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.846992 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.847220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.847464 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.847618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.847829 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.847963 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.848144 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.848287 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.848440 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.848597 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.848755 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.848895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.849067 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.849217 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.849379 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.849530 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.849758 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.849905 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.850082 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.850235 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.850398 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.850555 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.850703 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.850843 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.851015 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.851163 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.851331 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.851468 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.851648 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.851796 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.851961 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.852115 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.852259 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.852402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.852561 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.852718 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.852865 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.853004 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.853167 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.853308 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.853487 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.853666 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.853849 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.853997 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.854167 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.854313 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.854732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.854884 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.855063 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.855209 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.855612 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.856293 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.856434 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.856537 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.856668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.856767 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.856847 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.857005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.857162 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.857335 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.857484 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.857691 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.857831 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.858012 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.858109 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.858335 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.858501 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.858649 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.858826 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.858983 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.859151 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.859324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.859480 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.859657 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.859797 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.859986 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.860130 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.860296 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.860461 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.860604 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.860778 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.860911 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.861102 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.861222 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.861420 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.861557 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.861783 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.861939 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.862128 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.862264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.862464 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.862593 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.862797 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.862902 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.863110 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.863212 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.863420 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.863523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.863732 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.863838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.864046 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.864139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.864385 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.864485 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.864724 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.864841 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.865041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.865142 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.865357 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.865464 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.865792 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.865899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.865999 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.866094 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.866301 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.866411 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.866616 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.866734 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.866944 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.867053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.867252 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.867355 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.867561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.867676 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.867879 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.867983 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.868197 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.868304 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.868514 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.868613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.868827 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.868918 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.869140 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.869240 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.869450 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.869541 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.869785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.869893 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.870117 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.870224 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.870433 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.870534 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.870746 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.870838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.871059 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.871151 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.871396 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.872109 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.872249 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.872335 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.872611 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.872735 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.872946 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.873058 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.873276 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.873381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.873705 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.877739 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.877862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.877964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.877964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878117 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878204 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878286 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878367 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878448 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878529 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878615 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878760 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878836 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878908 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.878978 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.879061 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 03:11:33.879135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.879135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.879135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.879135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.879135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.879135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.879135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.879135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 03:11:33.879657 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 03:11:33.898840 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_db.sqlalchemy.engines [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:11:33.903352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_db.sqlalchemy.engines [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:11:33.969116 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.context [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43b8c604-540b-400e-b8d3-fef97c564d54(cell1) {{(pid=116001) load_cells /opt/stack/nova/nova/context.py:464}} Dec 18 03:11:33.970116 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.context [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43b8c604-540b-400e-b8d3-fef97c564d54(cell1) {{(pid=116000) load_cells /opt/stack/nova/nova/context.py:464}} Dec 18 03:11:33.973324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:11:33.974336 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:11:33.975035 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:11:33.975876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:11:33.975989 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:11:33.976799 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:11:33.977875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:11:33.978759 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:11:33.991120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_db.sqlalchemy.engines [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:11:33.993775 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_db.sqlalchemy.engines [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:11:33.995041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_db.sqlalchemy.engines [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:11:33.995315 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_db.sqlalchemy.engines [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:11:34.160138 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_db.sqlalchemy.engines [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:11:34.161112 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_db.sqlalchemy.engines [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 03:11:34.489818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: WARNING keystonemiddleware.auth_token [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 03:11:34.493036 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: WARNING keystonemiddleware.auth_token [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 03:11:34.496474 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: WARNING keystonemiddleware.auth_token [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 03:11:34.501222 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: WARNING keystonemiddleware.auth_token [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 03:11:34.840402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: WARNING keystonemiddleware.auth_token [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 03:11:34.845644 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: WARNING keystonemiddleware.auth_token [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 18 03:11:34.846316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: WARNING keystonemiddleware.auth_token [None req-e57eb081-9c8c-469c-8c16-ffc5e5779bf5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 03:11:34.851365 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: WARNING keystonemiddleware.auth_token [None req-253959a2-4c1b-4c1d-8184-6a17b935601b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 18 03:11:34.851658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f27dbc49c0 pid: 116001 (default app) Dec 18 03:11:34.857029 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f27dbc49c0 pid: 116000 (default app) Dec 18 03:12:09.112548 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c1cc9339-c4ee-4490-95a8-610bd7f7cdfc tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Action: 'create', calling method: .version_select at 0x7fad281d7e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2110033501", "metadata": {"Type": "work"}}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:09.115061 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c1cc9339-c4ee-4490-95a8-610bd7f7cdfc tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:12:09.116748 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c1cc9339-c4ee-4490-95a8-610bd7f7cdfc tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.836849 Dec 18 03:12:09.117647 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1155 bytes} [Sat Dec 18 03:12:07 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1839 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:12:09.434286 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5a533d45-3c0f-45c4-b692-3418dd34271d tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Action: 'create', calling method: .version_select at 0x7fad28225a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2011335668", "metadata": {"Type": "work"}}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:09.436667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5a533d45-3c0f-45c4-b692-3418dd34271d tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:12:09.438271 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5a533d45-3c0f-45c4-b692-3418dd34271d tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.313454 Dec 18 03:12:09.439146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 1/2] 10.222.0.24 () {60 vars in 1155 bytes} [Sat Dec 18 03:12:09 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:12:09.448830 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c9002923-2bef-4e74-ad45-ba5ff09e8fac tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Action: 'create', calling method: .version_select at 0x7fad2823d5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-867920891", "metadata": {"Type": "work"}}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:09.455083 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c9002923-2bef-4e74-ad45-ba5ff09e8fac tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:12:09.457010 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c9002923-2bef-4e74-ad45-ba5ff09e8fac tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012757 Dec 18 03:12:09.458736 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 2/3] 10.222.0.24 () {60 vars in 1155 bytes} [Sat Dec 18 03:12:09 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:12:09.467516 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-10b2b59f-ed39-4413-a44b-fc03cdb81ef8 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Calling method '.version_select at 0x7fad28225b80>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:09.718238 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1707269432", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "networks": [{"uuid": "611006f3-a73d-4a4d-a0ee-79b37818606d"}]}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:10.640359 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] validate_networks() for [('611006f3-a73d-4a4d-a0ee-79b37818606d', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:12:10.665890 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-10b2b59f-ed39-4413-a44b-fc03cdb81ef8 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] HTTP exception thrown: Volume tempest-invalid-1921449962 could not be found. Dec 18 03:12:10.666657 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-10b2b59f-ed39-4413-a44b-fc03cdb81ef8 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Returning 404 to user: Volume tempest-invalid-1921449962 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:12:10.667619 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-10b2b59f-ed39-4413-a44b-fc03cdb81ef8 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1921449962" status: 404 len: 99 microversion: 2.1 time: 1.204309 Dec 18 03:12:10.668345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 3/4] 10.222.0.24 () {58 vars in 1217 bytes} [Sat Dec 18 03:12:09 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1921449962 => generated 99 bytes in 1205 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 18 03:12:10.881228 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1341731159", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "networks": [{"uuid": "1d8dfc79-d3fb-4837-9660-6625a84f5064"}]}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:11.066964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] validate_networks() for [('1d8dfc79-d3fb-4837-9660-6625a84f5064', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:12:12.121440 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:12:12.122690 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:12:12.123367 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:12:12.123979 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:12:12.124772 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:12:12.142610 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:12.143166 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:12.144147 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:12.145666 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:12.193872 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Getting quotas for project 5c6b1669a90f442992fb339de8e51e55. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:12:12.203541 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Getting quotas for user 800bdf7105074aac90836d4bbcc483b0 and project 5c6b1669a90f442992fb339de8e51e55. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:12:12.218915 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:12:12.221928 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:12:12.345170 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ba3a5591-eb09-4c24-aaea-d53025b53945 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.000944 Dec 18 03:12:12.351617 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 2/5] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:12:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 3008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:12:12.359204 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-aebc6ec1-bf33-45c8-b7f4-ae236a866471 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad277e0790>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:12.396123 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:12:12.396667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:12:12.397003 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:12:12.397406 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:12:12.397841 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:12:12.440907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:12.441454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:12.442927 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:12.444731 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:12.474196 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-aebc6ec1-bf33-45c8-b7f4-ae236a866471 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5b5af97c-648c-4e40-b5be-c3f10f14b869" status: 200 len: 350 microversion: 2.1 time: 0.120256 Dec 18 03:12:12.475165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 3/6] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:12:12 2021] GET /compute/v2.1/os-volumes/5b5af97c-648c-4e40-b5be-c3f10f14b869 => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:12.482020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-58f29b02-fe4e-48a0-bb1c-2c88802d9d6d tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005062 Dec 18 03:12:12.482829 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1139 bytes} [Sat Dec 18 03:12:12 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 18 03:12:12.501586 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ba8d4646-404a-4982-9933-4ab1eb13310e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:12.502259 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ba8d4646-404a-4982-9933-4ab1eb13310e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:12.571402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Getting quotas for project e04a810a1bed41eb90634777ccbde0f4. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:12:12.588306 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Getting quotas for user 208a33c69dc44f399bac2a34bc018ef1 and project e04a810a1bed41eb90634777ccbde0f4. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:12:12.623462 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:12:12.626949 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:12:12.741339 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ba8d4646-404a-4982-9933-4ab1eb13310e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:12.778547 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ba8d4646-404a-4982-9933-4ab1eb13310e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1215 microversion: 2.1 time: 0.290071 Dec 18 03:12:12.790482 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 5/8] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:12 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:12.802285 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-586e988e-fbdf-40ff-a8fb-61340a32d617 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003605 Dec 18 03:12:12.822279 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 6/9] 10.222.0.24 () {58 vars in 1136 bytes} [Sat Dec 18 03:12:12 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 18 03:12:12.830261 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a9cc19b2-b709-49e7-a969-a0c544057fc0 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Calling method '.version_select at 0x7fad26f61c10>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:12.846977 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1c524bea-d4ce-4baf-bd40-3cf89b4a1b74 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.177728 Dec 18 03:12:12.847627 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 4/10] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:12:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:12:12.859402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0dc5e3e9-9a89-4979-a432-32e84d3a4b55 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:12.860032 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0dc5e3e9-9a89-4979-a432-32e84d3a4b55 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:12.995845 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-a9cc19b2-b709-49e7-a969-a0c544057fc0 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] HTTP exception thrown: Volume fe9c843f-8d95-4073-a6da-2b454642596f could not be found. Dec 18 03:12:12.996712 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a9cc19b2-b709-49e7-a969-a0c544057fc0 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Returning 404 to user: Volume fe9c843f-8d95-4073-a6da-2b454642596f could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:12:12.997813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a9cc19b2-b709-49e7-a969-a0c544057fc0 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/fe9c843f-8d95-4073-a6da-2b454642596f" status: 404 len: 109 microversion: 2.1 time: 0.171219 Dec 18 03:12:12.998600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 7/11] 10.222.0.24 () {58 vars in 1247 bytes} [Sat Dec 18 03:12:12 2021] DELETE /compute/v2.1/os-volumes/fe9c843f-8d95-4073-a6da-2b454642596f => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:12:13.009514 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-31e273cb-9fff-4dbd-963b-2b4172083890 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Calling method '.version_select at 0x7fad26f718b0>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:13.071838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0dc5e3e9-9a89-4979-a432-32e84d3a4b55 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:13.100818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-31e273cb-9fff-4dbd-963b-2b4172083890 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] HTTP exception thrown: Volume cef81dd9-d0d6-40a3-8f99-3354b832f0c6 could not be found. Dec 18 03:12:13.102198 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-31e273cb-9fff-4dbd-963b-2b4172083890 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] Returning 404 to user: Volume cef81dd9-d0d6-40a3-8f99-3354b832f0c6 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:12:13.103023 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-31e273cb-9fff-4dbd-963b-2b4172083890 tempest-VolumesNegativeTest-1169898885 tempest-VolumesNegativeTest-1169898885-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/cef81dd9-d0d6-40a3-8f99-3354b832f0c6" status: 404 len: 109 microversion: 2.1 time: 0.098565 Dec 18 03:12:13.103462 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0dc5e3e9-9a89-4979-a432-32e84d3a4b55 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1218 microversion: 2.1 time: 0.245227 Dec 18 03:12:13.104139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 8/12] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:12:13 2021] GET /compute/v2.1/os-volumes/cef81dd9-d0d6-40a3-8f99-3354b832f0c6 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 03:12:13.135855 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 5/13] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:12 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1218 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:12:13.797913 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ba90c05f-cb59-4b88-82e3-ca2f453478a4 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:13.798678 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ba90c05f-cb59-4b88-82e3-ca2f453478a4 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:13.918034 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ba90c05f-cb59-4b88-82e3-ca2f453478a4 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:13.927098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ba90c05f-cb59-4b88-82e3-ca2f453478a4 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1215 microversion: 2.1 time: 0.133372 Dec 18 03:12:13.929271 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 9/14] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:13 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:14.122804 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2371c4db-2baa-4795-9a38-c6c7c1999ca0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:14.124071 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2371c4db-2baa-4795-9a38-c6c7c1999ca0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:14.281131 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2371c4db-2baa-4795-9a38-c6c7c1999ca0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:14.292882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2371c4db-2baa-4795-9a38-c6c7c1999ca0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1218 microversion: 2.1 time: 0.173256 Dec 18 03:12:14.309974 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 6/15] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:14 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1218 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:14.325955 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4f0f74b9-abe0-461d-853c-489734636b54 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26f105e0>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:14.420131 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4f0f74b9-abe0-461d-853c-489734636b54 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/702b210a-61d7-4775-b3f4-ed908f1b9360" status: 200 len: 351 microversion: 2.1 time: 0.098366 Dec 18 03:12:14.426956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 10/16] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:12:14 2021] GET /compute/v2.1/os-volumes/702b210a-61d7-4775-b3f4-ed908f1b9360 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:14.947124 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ffca836e-a000-4750-915a-9be2704373b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:14.948949 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ffca836e-a000-4750-915a-9be2704373b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:14.960251 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ffca836e-a000-4750-915a-9be2704373b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:14.960721 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ffca836e-a000-4750-915a-9be2704373b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:14.963050 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ffca836e-a000-4750-915a-9be2704373b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:14.965344 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ffca836e-a000-4750-915a-9be2704373b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:15.311440 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-45c2201f-d741-4bca-9dc9-2544c67d2b47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:15.312050 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-45c2201f-d741-4bca-9dc9-2544c67d2b47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:15.329974 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-45c2201f-d741-4bca-9dc9-2544c67d2b47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:15.331305 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-45c2201f-d741-4bca-9dc9-2544c67d2b47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:15.337670 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-45c2201f-d741-4bca-9dc9-2544c67d2b47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:15.339879 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-45c2201f-d741-4bca-9dc9-2544c67d2b47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:15.394527 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ffca836e-a000-4750-915a-9be2704373b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:15.435973 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ffca836e-a000-4750-915a-9be2704373b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1211 microversion: 2.1 time: 0.493452 Dec 18 03:12:15.437893 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 7/17] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:14 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1211 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:12:16.026030 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-45c2201f-d741-4bca-9dc9-2544c67d2b47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:16.039216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-45c2201f-d741-4bca-9dc9-2544c67d2b47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1214 microversion: 2.1 time: 0.732564 Dec 18 03:12:16.040390 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 11/18] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:15 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1214 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:16.345662 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-37683b43-071c-40b5-8b0c-78d8968a0edf tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26eff8b0>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:16.440331 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-37683b43-071c-40b5-8b0c-78d8968a0edf tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/30610cef-c9c7-4c6c-b0ed-80d609552ad5" status: 200 len: 351 microversion: 2.1 time: 0.098316 Dec 18 03:12:16.441915 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 8/19] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:12:16 2021] GET /compute/v2.1/os-volumes/30610cef-c9c7-4c6c-b0ed-80d609552ad5 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:16.458638 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bcc4c1f9-8a82-401a-a401-027e440cbdba tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26e88d30>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:16.460956 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9c136038-31c4-4064-9f04-0199507dc04f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:16.462086 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9c136038-31c4-4064-9f04-0199507dc04f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:16.478702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9c136038-31c4-4064-9f04-0199507dc04f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:16.478702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9c136038-31c4-4064-9f04-0199507dc04f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:16.493583 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9c136038-31c4-4064-9f04-0199507dc04f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:16.494085 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9c136038-31c4-4064-9f04-0199507dc04f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:16.643312 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9c136038-31c4-4064-9f04-0199507dc04f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:16.657280 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9c136038-31c4-4064-9f04-0199507dc04f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1267 microversion: 2.1 time: 0.203964 Dec 18 03:12:16.667907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 9/20] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:16 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:16.769496 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bcc4c1f9-8a82-401a-a401-027e440cbdba tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.318954 Dec 18 03:12:16.777899 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 12/21] 10.222.0.24 () {58 vars in 1133 bytes} [Sat Dec 18 03:12:16 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:16.782985 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-54cc714d-ff75-4e26-bf2d-5ac746fd097e tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26eb0d30>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:17.055877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a4d00e5e-f84c-4b44-b888-38c904c2b657 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:17.056492 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a4d00e5e-f84c-4b44-b888-38c904c2b657 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:17.065222 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a4d00e5e-f84c-4b44-b888-38c904c2b657 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:17.065708 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a4d00e5e-f84c-4b44-b888-38c904c2b657 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:17.066510 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a4d00e5e-f84c-4b44-b888-38c904c2b657 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:17.066950 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a4d00e5e-f84c-4b44-b888-38c904c2b657 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:17.227299 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-54cc714d-ff75-4e26-bf2d-5ac746fd097e tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.448047 Dec 18 03:12:17.228141 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 10/22] 10.222.0.24 () {58 vars in 1148 bytes} [Sat Dec 18 03:12:16 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:17.240144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6aeb0a7b-2a17-4802-ab9c-3f198041ee3d tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26e4e0d0>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:17.262529 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a4d00e5e-f84c-4b44-b888-38c904c2b657 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:17.270879 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a4d00e5e-f84c-4b44-b888-38c904c2b657 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1214 microversion: 2.1 time: 0.218491 Dec 18 03:12:17.273157 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 13/23] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:17 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:17.363524 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6aeb0a7b-2a17-4802-ab9c-3f198041ee3d tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.126831 Dec 18 03:12:17.364827 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 11/24] 10.222.0.24 () {58 vars in 1133 bytes} [Sat Dec 18 03:12:17 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:17.379268 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-78f82806-d4b5-463d-8a95-7086458ed8a2 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26e9b160>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:17.550822 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-78f82806-d4b5-463d-8a95-7086458ed8a2 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.176901 Dec 18 03:12:17.558797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 14/25] 10.222.0.24 () {58 vars in 1166 bytes} [Sat Dec 18 03:12:17 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:17.570386 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-deceba21-0737-4271-aea0-f8dddceef267 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26ec0ca0>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:17.677788 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-44161406-119a-42c8-a010-9e807da1778d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:17.679183 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-44161406-119a-42c8-a010-9e807da1778d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:17.687992 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-44161406-119a-42c8-a010-9e807da1778d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:17.688751 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-44161406-119a-42c8-a010-9e807da1778d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:17.689871 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-44161406-119a-42c8-a010-9e807da1778d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:17.690553 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-44161406-119a-42c8-a010-9e807da1778d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:17.788096 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-deceba21-0737-4271-aea0-f8dddceef267 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.225531 Dec 18 03:12:17.788879 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 12/26] 10.222.0.24 () {58 vars in 1169 bytes} [Sat Dec 18 03:12:17 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:17.801660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c47c8405-13f6-4115-b130-6148fd8e51b7 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26eb0f70>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:17.868211 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-44161406-119a-42c8-a010-9e807da1778d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:17.885295 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-44161406-119a-42c8-a010-9e807da1778d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1267 microversion: 2.1 time: 0.212708 Dec 18 03:12:17.889714 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 15/27] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:17 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:18.046103 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c47c8405-13f6-4115-b130-6148fd8e51b7 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.248344 Dec 18 03:12:18.046951 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 13/28] 10.222.0.24 () {58 vars in 1154 bytes} [Sat Dec 18 03:12:17 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:18.059721 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8903f331-c2ce-4795-9599-d9ec86397784 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26eb3310>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:18.252128 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8903f331-c2ce-4795-9599-d9ec86397784 tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.197350 Dec 18 03:12:18.260342 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 16/29] 10.222.0.24 () {58 vars in 1187 bytes} [Sat Dec 18 03:12:18 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:18.265002 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-47bfcb52-a3ea-4972-a434-c4ebf9952e9d tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] Calling method '.version_select at 0x7fad26e4e940>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:18.289807 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-dbaf4ded-0348-4c41-a7e3-d8cfa8321fe3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:18.290988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-dbaf4ded-0348-4c41-a7e3-d8cfa8321fe3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:18.305318 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dbaf4ded-0348-4c41-a7e3-d8cfa8321fe3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:18.306284 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dbaf4ded-0348-4c41-a7e3-d8cfa8321fe3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:18.318847 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dbaf4ded-0348-4c41-a7e3-d8cfa8321fe3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:18.321056 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dbaf4ded-0348-4c41-a7e3-d8cfa8321fe3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:18.400858 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-47bfcb52-a3ea-4972-a434-c4ebf9952e9d tempest-VolumesTestJSON-1104115086 tempest-VolumesTestJSON-1104115086-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.140180 Dec 18 03:12:18.404495 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 14/30] 10.222.0.24 () {58 vars in 1154 bytes} [Sat Dec 18 03:12:18 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:18.446029 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-dbaf4ded-0348-4c41-a7e3-d8cfa8321fe3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:18.454269 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-dbaf4ded-0348-4c41-a7e3-d8cfa8321fe3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1214 microversion: 2.1 time: 0.169908 Dec 18 03:12:18.454843 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 17/31] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:18 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:18.903156 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-276999c8-1150-4173-9250-85bb0b64a37b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:18.904442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-276999c8-1150-4173-9250-85bb0b64a37b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:18.910834 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-276999c8-1150-4173-9250-85bb0b64a37b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:18.911284 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-276999c8-1150-4173-9250-85bb0b64a37b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:18.912070 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-276999c8-1150-4173-9250-85bb0b64a37b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:18.912505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-276999c8-1150-4173-9250-85bb0b64a37b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:19.031446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-276999c8-1150-4173-9250-85bb0b64a37b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:19.039353 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-276999c8-1150-4173-9250-85bb0b64a37b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1275 microversion: 2.1 time: 0.140198 Dec 18 03:12:19.052938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 18/32] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:18 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:19.257700 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ba6e0693-8232-414d-bea6-87227e3cf9fa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'create', calling method: .version_select at 0x7fad26e4e430>, body: {"keypair": {"name": "tempest-keypair-1204234000"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:19.286526 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-ba6e0693-8232-414d-bea6-87227e3cf9fa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for project 9f27614e91de40f2ba636e557961e94f. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:12:19.293136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-ba6e0693-8232-414d-bea6-87227e3cf9fa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for user eab89208d73e45878ea797026c7741f8 and project 9f27614e91de40f2ba636e557961e94f. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:12:19.472308 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ffbfacac-6ca6-462f-a935-3407c6f78742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:19.473315 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ffbfacac-6ca6-462f-a935-3407c6f78742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:19.485773 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ffbfacac-6ca6-462f-a935-3407c6f78742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:19.486647 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ffbfacac-6ca6-462f-a935-3407c6f78742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:19.489661 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ffbfacac-6ca6-462f-a935-3407c6f78742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:19.490389 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ffbfacac-6ca6-462f-a935-3407c6f78742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:19.508266 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-ba6e0693-8232-414d-bea6-87227e3cf9fa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for project 9f27614e91de40f2ba636e557961e94f. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:12:19.513577 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-ba6e0693-8232-414d-bea6-87227e3cf9fa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for user eab89208d73e45878ea797026c7741f8 and project 9f27614e91de40f2ba636e557961e94f. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:12:19.529712 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ba6e0693-8232-414d-bea6-87227e3cf9fa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.784301 Dec 18 03:12:19.532182 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 15/33] 10.222.0.24 () {62 vars in 1198 bytes} [Sat Dec 18 03:12:18 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 788 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 03:12:19.804979 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ffbfacac-6ca6-462f-a935-3407c6f78742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:19.815888 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ffbfacac-6ca6-462f-a935-3407c6f78742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1270 microversion: 2.1 time: 0.348557 Dec 18 03:12:19.820155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 19/34] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:19 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1270 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:12:20.059831 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-57c63bc1-8f1f-45f1-b410-f3eb463f3683 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:20.060466 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-57c63bc1-8f1f-45f1-b410-f3eb463f3683 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:20.069535 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-57c63bc1-8f1f-45f1-b410-f3eb463f3683 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:20.070182 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-57c63bc1-8f1f-45f1-b410-f3eb463f3683 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:20.072604 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-57c63bc1-8f1f-45f1-b410-f3eb463f3683 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:20.075414 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-57c63bc1-8f1f-45f1-b410-f3eb463f3683 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:20.472543 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-57c63bc1-8f1f-45f1-b410-f3eb463f3683 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:20.489108 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-57c63bc1-8f1f-45f1-b410-f3eb463f3683 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1273 microversion: 2.1 time: 0.433005 Dec 18 03:12:20.491075 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 16/35] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:20 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1273 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:20.838190 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-fcdb7506-a9df-4e3e-afeb-81a50796f27b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:20.838672 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-fcdb7506-a9df-4e3e-afeb-81a50796f27b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:20.869522 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcdb7506-a9df-4e3e-afeb-81a50796f27b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:20.872439 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcdb7506-a9df-4e3e-afeb-81a50796f27b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:20.879787 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcdb7506-a9df-4e3e-afeb-81a50796f27b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:20.881414 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcdb7506-a9df-4e3e-afeb-81a50796f27b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:21.511232 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-76d02678-2701-4660-bff2-3b6b99cbb96e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:21.512443 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-76d02678-2701-4660-bff2-3b6b99cbb96e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:21.524363 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-76d02678-2701-4660-bff2-3b6b99cbb96e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:21.525323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-76d02678-2701-4660-bff2-3b6b99cbb96e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:21.528441 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-76d02678-2701-4660-bff2-3b6b99cbb96e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:21.529985 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-76d02678-2701-4660-bff2-3b6b99cbb96e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:21.796197 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fcdb7506-a9df-4e3e-afeb-81a50796f27b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:21.809164 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-fcdb7506-a9df-4e3e-afeb-81a50796f27b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1276 microversion: 2.1 time: 0.976102 Dec 18 03:12:21.812769 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 20/36] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:20 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1276 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:22.570702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-76d02678-2701-4660-bff2-3b6b99cbb96e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:22.593737 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-76d02678-2701-4660-bff2-3b6b99cbb96e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 1.088989 Dec 18 03:12:22.601077 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 17/37] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:21 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:22.829275 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ff3c0430-deb4-4934-826e-db1e370d6399 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:22.829996 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ff3c0430-deb4-4934-826e-db1e370d6399 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:22.845935 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff3c0430-deb4-4934-826e-db1e370d6399 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:22.846388 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff3c0430-deb4-4934-826e-db1e370d6399 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:22.847197 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff3c0430-deb4-4934-826e-db1e370d6399 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:22.852197 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff3c0430-deb4-4934-826e-db1e370d6399 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:23.618370 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-73e6ff21-898d-4a82-a293-045deedc5646 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:23.620249 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-73e6ff21-898d-4a82-a293-045deedc5646 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:23.635326 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73e6ff21-898d-4a82-a293-045deedc5646 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:23.636315 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73e6ff21-898d-4a82-a293-045deedc5646 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:23.637383 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73e6ff21-898d-4a82-a293-045deedc5646 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:23.637999 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73e6ff21-898d-4a82-a293-045deedc5646 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:23.910940 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ff3c0430-deb4-4934-826e-db1e370d6399 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:23.923445 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ff3c0430-deb4-4934-826e-db1e370d6399 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 1.097777 Dec 18 03:12:23.924042 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 21/38] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:22 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:24.858705 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-73e6ff21-898d-4a82-a293-045deedc5646 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:24.879287 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-73e6ff21-898d-4a82-a293-045deedc5646 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 1.265096 Dec 18 03:12:24.903835 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 18/39] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:23 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:24.943693 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-789b2110-6d0d-4a11-9ca5-8f5b616411ab tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:24.944477 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-789b2110-6d0d-4a11-9ca5-8f5b616411ab tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:24.959118 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-789b2110-6d0d-4a11-9ca5-8f5b616411ab tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:24.966610 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-789b2110-6d0d-4a11-9ca5-8f5b616411ab tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:24.968670 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-789b2110-6d0d-4a11-9ca5-8f5b616411ab tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:24.971410 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-789b2110-6d0d-4a11-9ca5-8f5b616411ab tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:25.905183 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-51443d1d-12eb-4fc1-bf29-58961f13d264 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:25.906041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-51443d1d-12eb-4fc1-bf29-58961f13d264 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:25.926568 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-51443d1d-12eb-4fc1-bf29-58961f13d264 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:25.927334 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-51443d1d-12eb-4fc1-bf29-58961f13d264 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:25.928429 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-51443d1d-12eb-4fc1-bf29-58961f13d264 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:25.938382 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-51443d1d-12eb-4fc1-bf29-58961f13d264 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:26.003506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-789b2110-6d0d-4a11-9ca5-8f5b616411ab tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:26.014972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-789b2110-6d0d-4a11-9ca5-8f5b616411ab tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 1.076786 Dec 18 03:12:26.033361 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 22/40] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:24 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:26.827116 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-6c0b1c24-91a1-4080-84d2-aa2c464d97e5 req-62addde9-f32d-456a-90e6-bbeab0a4ce3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e00542-7c0f-4f71-911f-b0b3a6d4c599", "tag": "e9a28560-c549-4e92-8993-34d623482c10"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:26.830715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:12:26.830715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:12:26.843938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-6c0b1c24-91a1-4080-84d2-aa2c464d97e5 req-62addde9-f32d-456a-90e6-bbeab0a4ce3e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:26.844630 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-6c0b1c24-91a1-4080-84d2-aa2c464d97e5 req-62addde9-f32d-456a-90e6-bbeab0a4ce3e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:26.869009 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-6c0b1c24-91a1-4080-84d2-aa2c464d97e5 req-62addde9-f32d-456a-90e6-bbeab0a4ce3e service nova] Creating event network-changed:e9a28560-c549-4e92-8993-34d623482c10 for instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 on hv-cinder-81803 Dec 18 03:12:26.870422 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-6c0b1c24-91a1-4080-84d2-aa2c464d97e5 req-62addde9-f32d-456a-90e6-bbeab0a4ce3e service nova] Acquired lock "compute-rpcapi-router" {{(pid=116001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 03:12:26.872418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-53f0fcd7-25aa-4eb2-af0a-603e6761999e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:26.873029 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-53f0fcd7-25aa-4eb2-af0a-603e6761999e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:26.874303 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-53f0fcd7-25aa-4eb2-af0a-603e6761999e None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:26.875024 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-53f0fcd7-25aa-4eb2-af0a-603e6761999e None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:26.888124 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.compute.rpcapi [None req-53f0fcd7-25aa-4eb2-af0a-603e6761999e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 18 03:12:26.889545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-53f0fcd7-25aa-4eb2-af0a-603e6761999e None None] Releasing lock "compute-rpcapi-router" {{(pid=116001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 03:12:26.927339 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-53f0fcd7-25aa-4eb2-af0a-603e6761999e None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203769 Dec 18 03:12:26.928844 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 23/41] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:12:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:12:27.036556 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a4ee0952-0213-4313-8e58-ea902ecafbf4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:27.037495 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a4ee0952-0213-4313-8e58-ea902ecafbf4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:27.059075 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a4ee0952-0213-4313-8e58-ea902ecafbf4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:27.059949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a4ee0952-0213-4313-8e58-ea902ecafbf4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:27.061009 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a4ee0952-0213-4313-8e58-ea902ecafbf4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:27.061659 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a4ee0952-0213-4313-8e58-ea902ecafbf4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:27.075228 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-51443d1d-12eb-4fc1-bf29-58961f13d264 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:27.092602 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-51443d1d-12eb-4fc1-bf29-58961f13d264 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 1.190574 Dec 18 03:12:27.113723 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 19/42] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:25 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:27.468350 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a4ee0952-0213-4313-8e58-ea902ecafbf4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:27.490933 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a4ee0952-0213-4313-8e58-ea902ecafbf4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.455374 Dec 18 03:12:27.506177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 24/43] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:27 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:12:28.112627 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8e07518b-2356-4606-8c88-3370863a395a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:28.114153 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8e07518b-2356-4606-8c88-3370863a395a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:28.124770 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8e07518b-2356-4606-8c88-3370863a395a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:28.126763 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8e07518b-2356-4606-8c88-3370863a395a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:28.129329 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8e07518b-2356-4606-8c88-3370863a395a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:28.130939 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8e07518b-2356-4606-8c88-3370863a395a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:28.522527 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d7028bcb-26aa-45d9-b1ad-c08e21c03a8d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:28.523881 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d7028bcb-26aa-45d9-b1ad-c08e21c03a8d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:28.531320 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d7028bcb-26aa-45d9-b1ad-c08e21c03a8d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:28.535058 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d7028bcb-26aa-45d9-b1ad-c08e21c03a8d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:28.536237 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d7028bcb-26aa-45d9-b1ad-c08e21c03a8d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:28.536825 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d7028bcb-26aa-45d9-b1ad-c08e21c03a8d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:28.840226 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d7028bcb-26aa-45d9-b1ad-c08e21c03a8d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:28.847740 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d7028bcb-26aa-45d9-b1ad-c08e21c03a8d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.328728 Dec 18 03:12:28.852949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 25/44] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:28 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:12:29.028691 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8e07518b-2356-4606-8c88-3370863a395a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:29.037954 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1695824546", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c2dc738-d6f1-48f3-b8e0-871e485e797e"}], "security_groups": [{"name": "tempest-securitygroup--1609129973"}], "key_name": "tempest-keypair-1204234000", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:29.046684 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8e07518b-2356-4606-8c88-3370863a395a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.938735 Dec 18 03:12:29.050001 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 20/45] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:28 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:29.301775 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] validate_networks() for [('9c2dc738-d6f1-48f3-b8e0-871e485e797e', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:12:29.895276 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-3227d1b9-3943-4582-a325-d85bd08dc8b5 req-135fc33a-bb9d-4098-931c-4951e995ad4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f325d5a-7adf-4af8-8559-7f60b99ed6e2", "tag": "7d0395bd-af1a-4b29-b3f8-68ce84d329fc"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:29.899147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:12:29.899147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:12:29.933727 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-3227d1b9-3943-4582-a325-d85bd08dc8b5 req-135fc33a-bb9d-4098-931c-4951e995ad4c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:29.934127 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-3227d1b9-3943-4582-a325-d85bd08dc8b5 req-135fc33a-bb9d-4098-931c-4951e995ad4c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:30.009660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-3227d1b9-3943-4582-a325-d85bd08dc8b5 req-135fc33a-bb9d-4098-931c-4951e995ad4c service nova] Creating event network-changed:7d0395bd-af1a-4b29-b3f8-68ce84d329fc for instance 9f325d5a-7adf-4af8-8559-7f60b99ed6e2 on hv-cinder-81803 Dec 18 03:12:30.010151 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-3227d1b9-3943-4582-a325-d85bd08dc8b5 req-135fc33a-bb9d-4098-931c-4951e995ad4c service nova] Acquired lock "compute-rpcapi-router" {{(pid=116000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 18 03:12:30.011321 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5999ef60-0045-45d3-b978-93c5e68f059c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:30.016274 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5999ef60-0045-45d3-b978-93c5e68f059c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:30.017462 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5999ef60-0045-45d3-b978-93c5e68f059c None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:30.018119 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5999ef60-0045-45d3-b978-93c5e68f059c None None] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:30.043941 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.compute.rpcapi [None req-5999ef60-0045-45d3-b978-93c5e68f059c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 18 03:12:30.047190 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5999ef60-0045-45d3-b978-93c5e68f059c None None] Releasing lock "compute-rpcapi-router" {{(pid=116000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 18 03:12:30.095880 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5999ef60-0045-45d3-b978-93c5e68f059c None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.448499 Dec 18 03:12:30.096492 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 21/46] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:12:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:12:30.107124 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-dde53e42-8cc6-4087-8bd1-71a8042bbe22 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:30.108103 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-dde53e42-8cc6-4087-8bd1-71a8042bbe22 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:30.127873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dde53e42-8cc6-4087-8bd1-71a8042bbe22 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:30.128347 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dde53e42-8cc6-4087-8bd1-71a8042bbe22 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:30.129169 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dde53e42-8cc6-4087-8bd1-71a8042bbe22 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:30.129609 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dde53e42-8cc6-4087-8bd1-71a8042bbe22 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:30.404807 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-dde53e42-8cc6-4087-8bd1-71a8042bbe22 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:30.414021 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-dde53e42-8cc6-4087-8bd1-71a8042bbe22 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.316107 Dec 18 03:12:30.426771 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 22/47] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:30 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:30.433041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9d100bf5-3ba3-49b6-8784-211ee14f1ccd tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:30.438266 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9d100bf5-3ba3-49b6-8784-211ee14f1ccd tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:30.448915 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9d100bf5-3ba3-49b6-8784-211ee14f1ccd tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:30.449684 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9d100bf5-3ba3-49b6-8784-211ee14f1ccd tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:30.450840 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9d100bf5-3ba3-49b6-8784-211ee14f1ccd tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:30.451542 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9d100bf5-3ba3-49b6-8784-211ee14f1ccd tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:30.776587 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:12:30.777230 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:12:30.778158 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:12:30.778745 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:12:30.779194 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:12:30.794704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:30.799626 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:30.799626 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:30.799626 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:30.843213 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for project 9f27614e91de40f2ba636e557961e94f. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:12:30.848449 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for user eab89208d73e45878ea797026c7741f8 and project 9f27614e91de40f2ba636e557961e94f. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:12:30.876890 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:12:30.878477 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9d100bf5-3ba3-49b6-8784-211ee14f1ccd tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:30.879289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:12:30.892389 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9d100bf5-3ba3-49b6-8784-211ee14f1ccd tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.460379 Dec 18 03:12:30.893177 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 23/48] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:30 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:30.996667 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ded5b734-eef9-49fb-8c54-60efe2296b88 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.965308 Dec 18 03:12:31.000023 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 26/49] 10.222.0.24 () {62 vars in 1187 bytes} [Sat Dec 18 03:12:29 2021] POST /compute/v2.1/servers => generated 402 bytes in 1969 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 18 03:12:31.018044 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e402d452-e66e-4ac3-a0f2-1ee13bca2e1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:31.018670 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e402d452-e66e-4ac3-a0f2-1ee13bca2e1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:31.281242 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e402d452-e66e-4ac3-a0f2-1ee13bca2e1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:31.290479 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e402d452-e66e-4ac3-a0f2-1ee13bca2e1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:31.298321 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e402d452-e66e-4ac3-a0f2-1ee13bca2e1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:31.299924 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e402d452-e66e-4ac3-a0f2-1ee13bca2e1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1282 microversion: 2.20 time: 0.292288 Dec 18 03:12:31.301645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 24/50] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:31 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1282 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:31.436086 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-32f889d0-95cf-492c-ad48-f4c6e2823bb4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:31.436463 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-32f889d0-95cf-492c-ad48-f4c6e2823bb4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:31.451010 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-32f889d0-95cf-492c-ad48-f4c6e2823bb4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:31.451458 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-32f889d0-95cf-492c-ad48-f4c6e2823bb4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:31.452284 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-32f889d0-95cf-492c-ad48-f4c6e2823bb4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:31.452685 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-32f889d0-95cf-492c-ad48-f4c6e2823bb4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:31.924852 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bfe978a1-589f-4b70-bf4e-cadb44e7eec8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:31.932243 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bfe978a1-589f-4b70-bf4e-cadb44e7eec8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:31.959509 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bfe978a1-589f-4b70-bf4e-cadb44e7eec8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:31.960234 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bfe978a1-589f-4b70-bf4e-cadb44e7eec8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:31.961216 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bfe978a1-589f-4b70-bf4e-cadb44e7eec8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:31.964992 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bfe978a1-589f-4b70-bf4e-cadb44e7eec8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:32.197391 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bfe978a1-589f-4b70-bf4e-cadb44e7eec8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:32.208062 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bfe978a1-589f-4b70-bf4e-cadb44e7eec8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.292656 Dec 18 03:12:32.208961 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 25/51] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:31 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:32.263592 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-32f889d0-95cf-492c-ad48-f4c6e2823bb4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:32.271352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-32f889d0-95cf-492c-ad48-f4c6e2823bb4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.840125 Dec 18 03:12:32.272088 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 27/52] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:31 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:32.318862 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:32.319483 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:32.325680 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:32.326136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:32.326928 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:32.327366 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:32.396508 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:32.408801 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:32.410375 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:32.411493 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-696cb547-6a05-40d0-94a3-96a821b828f2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1278 microversion: 2.20 time: 0.096844 Dec 18 03:12:32.415052 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 26/53] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:32 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:33.226244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-38e491ce-6383-4b89-8924-b44fd176bcf2 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:33.227298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-38e491ce-6383-4b89-8924-b44fd176bcf2 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:33.237971 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-38e491ce-6383-4b89-8924-b44fd176bcf2 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:33.239210 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-38e491ce-6383-4b89-8924-b44fd176bcf2 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:33.248951 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-38e491ce-6383-4b89-8924-b44fd176bcf2 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:33.250587 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-38e491ce-6383-4b89-8924-b44fd176bcf2 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:33.288840 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8d3840ef-6665-4a0d-8de6-780773aadd06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:33.289463 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8d3840ef-6665-4a0d-8de6-780773aadd06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:33.312816 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8d3840ef-6665-4a0d-8de6-780773aadd06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:33.313677 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8d3840ef-6665-4a0d-8de6-780773aadd06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:33.325136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8d3840ef-6665-4a0d-8de6-780773aadd06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:33.329091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8d3840ef-6665-4a0d-8de6-780773aadd06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:33.655802 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-38e491ce-6383-4b89-8924-b44fd176bcf2 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:33.666123 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-38e491ce-6383-4b89-8924-b44fd176bcf2 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.444346 Dec 18 03:12:33.672697 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 28/54] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:33 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:33.680130 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:33.681158 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:33.689502 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:33.690512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:33.691918 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:33.692624 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:33.708702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8d3840ef-6665-4a0d-8de6-780773aadd06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:33.719272 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8d3840ef-6665-4a0d-8de6-780773aadd06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.434539 Dec 18 03:12:33.720023 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 27/55] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:33 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:12:33.825049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:33.834401 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:33.837023 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:33.838762 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c476edfb-d638-4108-a166-98e16f2e4788 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1340 microversion: 2.20 time: 0.164452 Dec 18 03:12:33.839340 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 29/56] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:33 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1340 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:34.683532 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1a92e1b0-e500-4a8f-b451-a5a6bafbe924 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:34.685465 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1a92e1b0-e500-4a8f-b451-a5a6bafbe924 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:34.694359 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1a92e1b0-e500-4a8f-b451-a5a6bafbe924 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:34.696097 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1a92e1b0-e500-4a8f-b451-a5a6bafbe924 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:34.697082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1a92e1b0-e500-4a8f-b451-a5a6bafbe924 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:34.699999 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1a92e1b0-e500-4a8f-b451-a5a6bafbe924 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:34.736876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-011e2383-276b-4484-a251-9f0a5edbeb16 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:34.738148 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-011e2383-276b-4484-a251-9f0a5edbeb16 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:34.755658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-011e2383-276b-4484-a251-9f0a5edbeb16 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:34.757509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-011e2383-276b-4484-a251-9f0a5edbeb16 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:34.758962 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-011e2383-276b-4484-a251-9f0a5edbeb16 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:34.762037 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-011e2383-276b-4484-a251-9f0a5edbeb16 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:35.008124 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-011e2383-276b-4484-a251-9f0a5edbeb16 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:35.019926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-011e2383-276b-4484-a251-9f0a5edbeb16 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.286962 Dec 18 03:12:35.021117 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 30/57] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:34 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:35.026825 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:35.027921 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:35.035408 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:35.036294 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:35.037847 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:35.038545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:35.486700 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1a92e1b0-e500-4a8f-b451-a5a6bafbe924 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:35.495998 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1a92e1b0-e500-4a8f-b451-a5a6bafbe924 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.816721 Dec 18 03:12:35.498716 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 28/58] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:34 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:35.626565 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:35.638228 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:35.639933 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:35.644855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4a241895-7b82-4c17-9bff-b154a4a04bed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1408 microversion: 2.20 time: 0.622358 Dec 18 03:12:35.645456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 31/59] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:35 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1408 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:35.925837 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-1a0ac20a-245f-4734-b7b2-599e8966d17a req-3acfdd33-2db3-401e-afd7-8ea9861a1221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa82caa-8340-4f50-9989-2ddbc243fb40", "tag": "b9de074c-64ba-4630-b439-f53e09e04d4b"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:35.928093 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:12:35.928093 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:12:35.957415 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-1a0ac20a-245f-4734-b7b2-599e8966d17a req-3acfdd33-2db3-401e-afd7-8ea9861a1221 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:35.960267 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-1a0ac20a-245f-4734-b7b2-599e8966d17a req-3acfdd33-2db3-401e-afd7-8ea9861a1221 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:35.996176 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-1a0ac20a-245f-4734-b7b2-599e8966d17a req-3acfdd33-2db3-401e-afd7-8ea9861a1221 service nova] Creating event network-changed:b9de074c-64ba-4630-b439-f53e09e04d4b for instance aaa82caa-8340-4f50-9989-2ddbc243fb40 on hv-cinder-81803 Dec 18 03:12:36.013979 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-1a0ac20a-245f-4734-b7b2-599e8966d17a req-3acfdd33-2db3-401e-afd7-8ea9861a1221 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091617 Dec 18 03:12:36.017952 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 29/60] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:12:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:36.036987 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-96ad8b00-e8d9-4d47-b119-fdacb81e4bc3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:36.037603 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-96ad8b00-e8d9-4d47-b119-fdacb81e4bc3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:36.052480 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-96ad8b00-e8d9-4d47-b119-fdacb81e4bc3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:36.052943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-96ad8b00-e8d9-4d47-b119-fdacb81e4bc3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:36.053774 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-96ad8b00-e8d9-4d47-b119-fdacb81e4bc3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:36.054217 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-96ad8b00-e8d9-4d47-b119-fdacb81e4bc3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:36.331831 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-96ad8b00-e8d9-4d47-b119-fdacb81e4bc3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:36.344568 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-96ad8b00-e8d9-4d47-b119-fdacb81e4bc3 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.310788 Dec 18 03:12:36.345670 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 32/61] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:36 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:36.516494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6ad4fb4b-6aea-4ba3-8170-4134bd8db787 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:36.517402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6ad4fb4b-6aea-4ba3-8170-4134bd8db787 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:36.525149 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6ad4fb4b-6aea-4ba3-8170-4134bd8db787 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:36.525612 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6ad4fb4b-6aea-4ba3-8170-4134bd8db787 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:36.526496 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6ad4fb4b-6aea-4ba3-8170-4134bd8db787 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:36.526938 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6ad4fb4b-6aea-4ba3-8170-4134bd8db787 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:36.662902 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:36.663478 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:36.671486 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:36.671951 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:36.672738 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:36.673167 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:36.928151 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:36.941966 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:36.943681 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:36.944952 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8a21107a-3e7d-40df-8098-3dfa6d3a4595 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1408 microversion: 2.20 time: 0.285750 Dec 18 03:12:36.959142 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-6ad4fb4b-6aea-4ba3-8170-4134bd8db787 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:36.966702 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 33/62] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:36 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:36.968639 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6ad4fb4b-6aea-4ba3-8170-4134bd8db787 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.456068 Dec 18 03:12:36.969430 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 30/63] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:36 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:37.362042 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-780efb65-4abe-4ec9-8e66-4d6183f5f313 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:37.362732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-780efb65-4abe-4ec9-8e66-4d6183f5f313 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:37.374459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-780efb65-4abe-4ec9-8e66-4d6183f5f313 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:37.374968 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-780efb65-4abe-4ec9-8e66-4d6183f5f313 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:37.375938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-780efb65-4abe-4ec9-8e66-4d6183f5f313 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:37.377721 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-780efb65-4abe-4ec9-8e66-4d6183f5f313 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:37.631159 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-780efb65-4abe-4ec9-8e66-4d6183f5f313 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:37.641918 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-780efb65-4abe-4ec9-8e66-4d6183f5f313 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.284135 Dec 18 03:12:37.647859 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 34/64] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:37 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:37.965335 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:37.966363 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:37.978283 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:37.987876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a9aeda68-3ee5-421e-b8b5-fd8f7fffc14e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:37.988750 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a9aeda68-3ee5-421e-b8b5-fd8f7fffc14e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:37.992984 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:37.993989 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:37.997217 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a9aeda68-3ee5-421e-b8b5-fd8f7fffc14e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:37.998013 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:38.003481 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a9aeda68-3ee5-421e-b8b5-fd8f7fffc14e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:38.004490 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a9aeda68-3ee5-421e-b8b5-fd8f7fffc14e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:38.006811 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a9aeda68-3ee5-421e-b8b5-fd8f7fffc14e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:38.324698 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a9aeda68-3ee5-421e-b8b5-fd8f7fffc14e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:38.336899 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a9aeda68-3ee5-421e-b8b5-fd8f7fffc14e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.353008 Dec 18 03:12:38.347661 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 35/65] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:37 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:38.396679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:38.415444 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:38.417968 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:38.420689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9f3d84fa-6342-4994-8b66-7c007d6df00c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1408 microversion: 2.20 time: 0.460529 Dec 18 03:12:38.422094 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 31/66] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:37 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:38.665270 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-43a88c38-9fba-4abc-9330-e45cfceea49a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:38.667179 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-43a88c38-9fba-4abc-9330-e45cfceea49a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:38.678127 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43a88c38-9fba-4abc-9330-e45cfceea49a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:38.678816 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43a88c38-9fba-4abc-9330-e45cfceea49a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:38.679810 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43a88c38-9fba-4abc-9330-e45cfceea49a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:38.680448 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43a88c38-9fba-4abc-9330-e45cfceea49a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:38.822094 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-43a88c38-9fba-4abc-9330-e45cfceea49a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:38.830263 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-43a88c38-9fba-4abc-9330-e45cfceea49a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.169757 Dec 18 03:12:38.839895 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 36/67] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:38 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:39.354967 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ac758ede-601d-4863-957b-7276c4c43283 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:39.355713 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ac758ede-601d-4863-957b-7276c4c43283 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:39.362081 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac758ede-601d-4863-957b-7276c4c43283 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:39.362794 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac758ede-601d-4863-957b-7276c4c43283 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:39.363850 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac758ede-601d-4863-957b-7276c4c43283 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:39.364469 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac758ede-601d-4863-957b-7276c4c43283 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:39.439212 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:39.440232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:39.448107 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:39.448916 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:39.449876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:39.450366 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:39.562033 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ac758ede-601d-4863-957b-7276c4c43283 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:39.578921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ac758ede-601d-4863-957b-7276c4c43283 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.228029 Dec 18 03:12:39.579608 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 32/68] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:39 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:39.621922 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:39.629774 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:39.631328 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:39.632620 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c306ffd4-dde9-4313-bfe3-1974034fdb73 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1408 microversion: 2.20 time: 0.197666 Dec 18 03:12:39.633567 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 37/69] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:39 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:12:39.848386 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-92e5bd4a-b8fe-40c3-b36a-58fb4fe5242a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:39.849646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-92e5bd4a-b8fe-40c3-b36a-58fb4fe5242a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:39.859054 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-92e5bd4a-b8fe-40c3-b36a-58fb4fe5242a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:39.859664 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-92e5bd4a-b8fe-40c3-b36a-58fb4fe5242a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:39.860914 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-92e5bd4a-b8fe-40c3-b36a-58fb4fe5242a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:39.861476 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-92e5bd4a-b8fe-40c3-b36a-58fb4fe5242a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:40.031404 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-92e5bd4a-b8fe-40c3-b36a-58fb4fe5242a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:40.040245 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-92e5bd4a-b8fe-40c3-b36a-58fb4fe5242a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.196470 Dec 18 03:12:40.041029 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 33/70] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:39 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:40.595318 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-64cd8c60-3816-465c-b384-a91b2ec48d1e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:40.595924 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-64cd8c60-3816-465c-b384-a91b2ec48d1e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:40.601936 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-64cd8c60-3816-465c-b384-a91b2ec48d1e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:40.602552 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-64cd8c60-3816-465c-b384-a91b2ec48d1e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:40.604225 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-64cd8c60-3816-465c-b384-a91b2ec48d1e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:40.604551 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-64cd8c60-3816-465c-b384-a91b2ec48d1e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:40.652381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:40.653133 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:40.659738 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:40.660605 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:40.661697 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:40.662388 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:40.767393 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-64cd8c60-3816-465c-b384-a91b2ec48d1e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:40.778153 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-64cd8c60-3816-465c-b384-a91b2ec48d1e tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.186294 Dec 18 03:12:40.779216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 38/71] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:40 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:40.818446 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:40.828158 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:40.829714 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:40.830892 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4fcba26d-9dc5-409c-a2bb-158adda80f91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1408 microversion: 2.20 time: 0.183553 Dec 18 03:12:40.831521 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 34/72] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:40 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:12:41.058473 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6db4b913-d645-44e5-9243-70971266bad9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:41.059081 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6db4b913-d645-44e5-9243-70971266bad9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:41.065105 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6db4b913-d645-44e5-9243-70971266bad9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:41.065543 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6db4b913-d645-44e5-9243-70971266bad9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:41.067261 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6db4b913-d645-44e5-9243-70971266bad9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:41.068024 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6db4b913-d645-44e5-9243-70971266bad9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:41.332521 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6db4b913-d645-44e5-9243-70971266bad9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:41.345687 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6db4b913-d645-44e5-9243-70971266bad9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.291422 Dec 18 03:12:41.356641 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 39/73] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:41 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:41.795815 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-89484032-a880-4f99-9380-5f83fa1a92ec tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:41.796930 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-89484032-a880-4f99-9380-5f83fa1a92ec tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:41.804446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89484032-a880-4f99-9380-5f83fa1a92ec tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:41.804987 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89484032-a880-4f99-9380-5f83fa1a92ec tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:41.805996 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89484032-a880-4f99-9380-5f83fa1a92ec tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:41.806736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89484032-a880-4f99-9380-5f83fa1a92ec tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:41.950589 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-89484032-a880-4f99-9380-5f83fa1a92ec tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:41.958351 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-89484032-a880-4f99-9380-5f83fa1a92ec tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.167527 Dec 18 03:12:41.958926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 40/74] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:41 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:41.964343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:41.965114 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:41.970983 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:41.971432 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:41.972213 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:41.972648 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:42.112112 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:42.120563 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:42.122109 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:42.123270 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4c6f424f-7f56-4b02-82b1-0162deeabe3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1408 microversion: 2.20 time: 0.163235 Dec 18 03:12:42.133494 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 41/75] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:41 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:42.198485 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-dd148f50-9844-42fc-86b6-6aeec8a6b9b5 req-35726f14-9a93-4c1f-8bb6-33aba735509a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e00542-7c0f-4f71-911f-b0b3a6d4c599", "name": "network-vif-plugged", "status": "completed", "tag": "e9a28560-c549-4e92-8993-34d623482c10"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:42.200048 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:12:42.200048 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:12:42.210414 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-dd148f50-9844-42fc-86b6-6aeec8a6b9b5 req-35726f14-9a93-4c1f-8bb6-33aba735509a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:42.210876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-dd148f50-9844-42fc-86b6-6aeec8a6b9b5 req-35726f14-9a93-4c1f-8bb6-33aba735509a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:42.223009 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-dd148f50-9844-42fc-86b6-6aeec8a6b9b5 req-35726f14-9a93-4c1f-8bb6-33aba735509a service nova] Creating event network-vif-plugged:e9a28560-c549-4e92-8993-34d623482c10 for instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 on hv-cinder-81803 Dec 18 03:12:42.229115 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-dd148f50-9844-42fc-86b6-6aeec8a6b9b5 req-35726f14-9a93-4c1f-8bb6-33aba735509a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.536394 Dec 18 03:12:42.230606 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 35/76] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:12:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:42.364015 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b78c3940-4a4d-4523-a038-190d05fd8074 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:42.364546 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b78c3940-4a4d-4523-a038-190d05fd8074 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:42.372317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b78c3940-4a4d-4523-a038-190d05fd8074 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:42.373343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b78c3940-4a4d-4523-a038-190d05fd8074 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:42.374446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b78c3940-4a4d-4523-a038-190d05fd8074 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:42.375219 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b78c3940-4a4d-4523-a038-190d05fd8074 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:42.566792 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b78c3940-4a4d-4523-a038-190d05fd8074 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:42.577661 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b78c3940-4a4d-4523-a038-190d05fd8074 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.217592 Dec 18 03:12:42.581115 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 42/77] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:42 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:42.992766 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e1ecfc22-cfb2-49fc-b8b6-e56ccd3378b9 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:42.994057 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e1ecfc22-cfb2-49fc-b8b6-e56ccd3378b9 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:43.005084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e1ecfc22-cfb2-49fc-b8b6-e56ccd3378b9 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:43.006243 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e1ecfc22-cfb2-49fc-b8b6-e56ccd3378b9 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:43.007178 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e1ecfc22-cfb2-49fc-b8b6-e56ccd3378b9 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:43.007677 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e1ecfc22-cfb2-49fc-b8b6-e56ccd3378b9 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:43.141283 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:43.141919 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:43.148775 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:43.149218 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:43.150024 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:43.150984 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:43.183931 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e1ecfc22-cfb2-49fc-b8b6-e56ccd3378b9 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:43.192297 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e1ecfc22-cfb2-49fc-b8b6-e56ccd3378b9 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.217860 Dec 18 03:12:43.198779 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 36/78] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:42 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:43.308865 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:43.317805 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:43.321563 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:43.321563 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-da013a55-592e-4315-9280-3e186640197b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1408 microversion: 2.20 time: 0.183491 Dec 18 03:12:43.332189 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 43/79] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:43 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:43.602542 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bf9b4e0e-96b9-48c1-b2b9-87d619a80f7f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:43.603963 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bf9b4e0e-96b9-48c1-b2b9-87d619a80f7f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:43.612478 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf9b4e0e-96b9-48c1-b2b9-87d619a80f7f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:43.613168 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf9b4e0e-96b9-48c1-b2b9-87d619a80f7f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:43.614480 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf9b4e0e-96b9-48c1-b2b9-87d619a80f7f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:43.615473 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf9b4e0e-96b9-48c1-b2b9-87d619a80f7f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:43.856005 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bf9b4e0e-96b9-48c1-b2b9-87d619a80f7f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:43.871646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bf9b4e0e-96b9-48c1-b2b9-87d619a80f7f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.275975 Dec 18 03:12:43.874059 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 37/80] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:43 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:44.209397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c1db3876-2eeb-4542-82ec-0103ceb14b51 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:44.211449 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c1db3876-2eeb-4542-82ec-0103ceb14b51 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:44.217810 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c1db3876-2eeb-4542-82ec-0103ceb14b51 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:44.218095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c1db3876-2eeb-4542-82ec-0103ceb14b51 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:44.219126 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c1db3876-2eeb-4542-82ec-0103ceb14b51 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:44.219955 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c1db3876-2eeb-4542-82ec-0103ceb14b51 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:44.249600 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-3668d8e2-3f0b-4966-be96-17afc4365268 req-9d1cb378-fa83-4197-b239-1141d6505fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f325d5a-7adf-4af8-8559-7f60b99ed6e2", "name": "network-vif-plugged", "status": "completed", "tag": "7d0395bd-af1a-4b29-b3f8-68ce84d329fc"}, {"server_uuid": "aaa82caa-8340-4f50-9989-2ddbc243fb40", "name": "network-vif-plugged", "status": "completed", "tag": "b9de074c-64ba-4630-b439-f53e09e04d4b"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:44.251326 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:12:44.251326 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:12:44.262689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-3668d8e2-3f0b-4966-be96-17afc4365268 req-9d1cb378-fa83-4197-b239-1141d6505fec service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:44.263123 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-3668d8e2-3f0b-4966-be96-17afc4365268 req-9d1cb378-fa83-4197-b239-1141d6505fec service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:44.276911 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-3668d8e2-3f0b-4966-be96-17afc4365268 req-9d1cb378-fa83-4197-b239-1141d6505fec service nova] Creating event network-vif-plugged:7d0395bd-af1a-4b29-b3f8-68ce84d329fc for instance 9f325d5a-7adf-4af8-8559-7f60b99ed6e2 on hv-cinder-81803 Dec 18 03:12:44.277672 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-3668d8e2-3f0b-4966-be96-17afc4365268 req-9d1cb378-fa83-4197-b239-1141d6505fec service nova] Creating event network-vif-plugged:b9de074c-64ba-4630-b439-f53e09e04d4b for instance aaa82caa-8340-4f50-9989-2ddbc243fb40 on hv-cinder-81803 Dec 18 03:12:44.284456 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-3668d8e2-3f0b-4966-be96-17afc4365268 req-9d1cb378-fa83-4197-b239-1141d6505fec service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039014 Dec 18 03:12:44.285400 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 38/81] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:12:44 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:12:44.341181 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:44.342277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:44.351331 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:44.352084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:44.353183 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:44.354029 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:44.380871 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c1db3876-2eeb-4542-82ec-0103ceb14b51 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:44.388813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c1db3876-2eeb-4542-82ec-0103ceb14b51 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1315 microversion: 2.1 time: 0.182944 Dec 18 03:12:44.389571 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 44/82] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:44 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:44.581807 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:44.598656 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:44.603167 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:44.608673 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a5fda3e4-de89-4ed5-a07d-4cb2e09abf46 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1408 microversion: 2.20 time: 0.270841 Dec 18 03:12:44.611237 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 39/83] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:44 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:44.892629 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c9467d7c-b3e1-491f-a2ea-543ad6289c84 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:44.894069 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c9467d7c-b3e1-491f-a2ea-543ad6289c84 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:44.916926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9467d7c-b3e1-491f-a2ea-543ad6289c84 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:44.917639 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9467d7c-b3e1-491f-a2ea-543ad6289c84 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:44.918895 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9467d7c-b3e1-491f-a2ea-543ad6289c84 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:44.919807 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9467d7c-b3e1-491f-a2ea-543ad6289c84 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:45.170511 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c9467d7c-b3e1-491f-a2ea-543ad6289c84 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:45.177974 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c9467d7c-b3e1-491f-a2ea-543ad6289c84 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.290658 Dec 18 03:12:45.178553 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 45/84] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:44 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:45.409218 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-01b5b34a-d9c1-493e-8153-937919c1982b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:45.410431 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-01b5b34a-d9c1-493e-8153-937919c1982b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:45.418229 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-01b5b34a-d9c1-493e-8153-937919c1982b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:45.419078 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-01b5b34a-d9c1-493e-8153-937919c1982b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:45.420076 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-01b5b34a-d9c1-493e-8153-937919c1982b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:45.420700 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-01b5b34a-d9c1-493e-8153-937919c1982b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:45.621773 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-01b5b34a-d9c1-493e-8153-937919c1982b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:45.628894 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:45.629574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:45.636118 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-01b5b34a-d9c1-493e-8153-937919c1982b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1502 microversion: 2.1 time: 0.229082 Dec 18 03:12:45.637298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 40/85] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:45 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:12:45.640720 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:45.641881 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:45.644270 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:45.644925 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:45.833874 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:45.844943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:45.847415 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:45.849065 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f7249986-bc15-4d49-8209-f697c0a801f9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1408 microversion: 2.20 time: 0.224589 Dec 18 03:12:45.849650 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 46/86] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:45 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:12:46.196603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-eb6821b7-1b65-4a27-a306-eb42987eb6b7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:46.197578 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-eb6821b7-1b65-4a27-a306-eb42987eb6b7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:46.204063 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb6821b7-1b65-4a27-a306-eb42987eb6b7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:46.204508 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb6821b7-1b65-4a27-a306-eb42987eb6b7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:46.205368 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb6821b7-1b65-4a27-a306-eb42987eb6b7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:46.206068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb6821b7-1b65-4a27-a306-eb42987eb6b7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:46.409898 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-eb6821b7-1b65-4a27-a306-eb42987eb6b7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:46.419740 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-eb6821b7-1b65-4a27-a306-eb42987eb6b7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1318 microversion: 2.1 time: 0.227822 Dec 18 03:12:46.420594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 41/87] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:46 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:46.868003 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:46.868624 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:46.879036 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:46.879589 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:46.880426 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:46.881133 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:47.053232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:47.063813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:47.065817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:47.067455 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-be42a325-05a4-4428-a9a5-a3d2b1029eb6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1599 microversion: 2.20 time: 0.204354 Dec 18 03:12:47.082893 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 47/88] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:12:46 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:12:47.090435 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b41011d5-d0b8-4ef3-87ed-f70aa28c643d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:47.091060 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b41011d5-d0b8-4ef3-87ed-f70aa28c643d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:47.097355 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b41011d5-d0b8-4ef3-87ed-f70aa28c643d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:47.098161 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b41011d5-d0b8-4ef3-87ed-f70aa28c643d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:47.099461 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b41011d5-d0b8-4ef3-87ed-f70aa28c643d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:47.100705 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b41011d5-d0b8-4ef3-87ed-f70aa28c643d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:47.233076 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d0c198a6-9a0a-47ee-a5c4-9db8cccb2a3d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f574440-1b70-404a-9d88-3f59eb16b403"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:47.235010 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d0c198a6-9a0a-47ee-a5c4-9db8cccb2a3d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:47.243978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d0c198a6-9a0a-47ee-a5c4-9db8cccb2a3d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:47.244662 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d0c198a6-9a0a-47ee-a5c4-9db8cccb2a3d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:47.245444 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d0c198a6-9a0a-47ee-a5c4-9db8cccb2a3d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:47.248196 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d0c198a6-9a0a-47ee-a5c4-9db8cccb2a3d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:47.267955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b41011d5-d0b8-4ef3-87ed-f70aa28c643d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.182366 Dec 18 03:12:47.269527 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 42/89] 10.222.0.24 () {60 vars in 1315 bytes} [Sat Dec 18 03:12:47 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:12:47.437886 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-db4ef21c-7b74-45e4-a2f6-f70c7bc36d2e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:12:47.438750 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-db4ef21c-7b74-45e4-a2f6-f70c7bc36d2e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:47.448759 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db4ef21c-7b74-45e4-a2f6-f70c7bc36d2e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:47.450005 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db4ef21c-7b74-45e4-a2f6-f70c7bc36d2e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:47.452823 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db4ef21c-7b74-45e4-a2f6-f70c7bc36d2e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:47.454646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db4ef21c-7b74-45e4-a2f6-f70c7bc36d2e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:47.664176 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-db4ef21c-7b74-45e4-a2f6-f70c7bc36d2e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:12:47.671717 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-db4ef21c-7b74-45e4-a2f6-f70c7bc36d2e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1509 microversion: 2.1 time: 0.238601 Dec 18 03:12:47.672656 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 43/90] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:12:47 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:48.087070 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d0c198a6-9a0a-47ee-a5c4-9db8cccb2a3d tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "POST /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858755 Dec 18 03:12:48.092228 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 48/91] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:12:47 2021] POST /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599/os-volume_attachments => generated 194 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:12:48.831352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-55fc3398-bceb-4474-86d4-689d858c78d2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:48.832941 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-55fc3398-bceb-4474-86d4-689d858c78d2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:48.840320 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-5d0e9e66-0a54-4f61-b40f-151f847880f3 req-05bed98e-1f53-48cf-9e1e-7ec1eceddcbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa82caa-8340-4f50-9989-2ddbc243fb40", "tag": "b9de074c-64ba-4630-b439-f53e09e04d4b"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:48.840783 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-55fc3398-bceb-4474-86d4-689d858c78d2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:48.841466 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-55fc3398-bceb-4474-86d4-689d858c78d2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:48.842113 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:12:48.842113 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:12:48.842413 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-55fc3398-bceb-4474-86d4-689d858c78d2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:48.842908 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-55fc3398-bceb-4474-86d4-689d858c78d2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:48.857867 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-5d0e9e66-0a54-4f61-b40f-151f847880f3 req-05bed98e-1f53-48cf-9e1e-7ec1eceddcbc service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:48.858316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-5d0e9e66-0a54-4f61-b40f-151f847880f3 req-05bed98e-1f53-48cf-9e1e-7ec1eceddcbc service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:48.881255 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-5d0e9e66-0a54-4f61-b40f-151f847880f3 req-05bed98e-1f53-48cf-9e1e-7ec1eceddcbc service nova] Creating event network-changed:b9de074c-64ba-4630-b439-f53e09e04d4b for instance aaa82caa-8340-4f50-9989-2ddbc243fb40 on hv-cinder-81803 Dec 18 03:12:48.886927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-5d0e9e66-0a54-4f61-b40f-151f847880f3 req-05bed98e-1f53-48cf-9e1e-7ec1eceddcbc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051599 Dec 18 03:12:48.891197 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 49/92] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:12:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:12:50.637765 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-55fc3398-bceb-4474-86d4-689d858c78d2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 14 microversion: 2.20 time: 1.809833 Dec 18 03:12:50.638679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 44/93] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:12:48 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 14 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:51.596176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-296319a0-a7d6-42f1-9b74-75c1321048bf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "910c954c-ddcb-434c-ad26-8a3147930530"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:51.597329 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-296319a0-a7d6-42f1-9b74-75c1321048bf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:51.603953 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-296319a0-a7d6-42f1-9b74-75c1321048bf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:51.604395 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-296319a0-a7d6-42f1-9b74-75c1321048bf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:51.605424 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-296319a0-a7d6-42f1-9b74-75c1321048bf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:51.605879 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-296319a0-a7d6-42f1-9b74-75c1321048bf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:51.648694 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ad60d4a6-44c2-455c-8277-f3abc59bc950 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:51.649793 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ad60d4a6-44c2-455c-8277-f3abc59bc950 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:51.657889 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ad60d4a6-44c2-455c-8277-f3abc59bc950 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:51.658265 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ad60d4a6-44c2-455c-8277-f3abc59bc950 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:51.659040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ad60d4a6-44c2-455c-8277-f3abc59bc950 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:51.659464 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ad60d4a6-44c2-455c-8277-f3abc59bc950 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:51.763353 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ad60d4a6-44c2-455c-8277-f3abc59bc950 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 14 microversion: 2.20 time: 0.118598 Dec 18 03:12:51.766569 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 45/94] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:12:51 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:12:52.395668 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-296319a0-a7d6-42f1-9b74-75c1321048bf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "POST /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803833 Dec 18 03:12:52.396261 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 50/95] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:12:51 2021] POST /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:12:52.776084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-027489a7-e701-478d-8212-ef9f3e74572a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:52.777071 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-027489a7-e701-478d-8212-ef9f3e74572a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:52.783954 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-027489a7-e701-478d-8212-ef9f3e74572a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:52.784403 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-027489a7-e701-478d-8212-ef9f3e74572a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:52.785181 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-027489a7-e701-478d-8212-ef9f3e74572a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:52.785608 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-027489a7-e701-478d-8212-ef9f3e74572a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:52.901643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-027489a7-e701-478d-8212-ef9f3e74572a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 14 microversion: 2.20 time: 0.130070 Dec 18 03:12:52.904792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 46/96] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:12:52 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:53.913321 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c2065c84-1429-4c77-b62b-d6d751fefd44 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:53.914326 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c2065c84-1429-4c77-b62b-d6d751fefd44 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:53.920561 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2065c84-1429-4c77-b62b-d6d751fefd44 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:53.921001 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2065c84-1429-4c77-b62b-d6d751fefd44 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:53.921801 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2065c84-1429-4c77-b62b-d6d751fefd44 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:53.922229 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2065c84-1429-4c77-b62b-d6d751fefd44 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:55.877931 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c2065c84-1429-4c77-b62b-d6d751fefd44 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 14 microversion: 2.20 time: 1.968896 Dec 18 03:12:55.878564 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 51/97] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:12:53 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 14 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:56.888732 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cc313ce7-23fc-43ad-b006-c6a3190863e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:56.889779 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cc313ce7-23fc-43ad-b006-c6a3190863e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:56.896664 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc313ce7-23fc-43ad-b006-c6a3190863e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:56.897413 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc313ce7-23fc-43ad-b006-c6a3190863e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:56.897886 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc313ce7-23fc-43ad-b006-c6a3190863e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:56.898315 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc313ce7-23fc-43ad-b006-c6a3190863e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:56.997530 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cc313ce7-23fc-43ad-b006-c6a3190863e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 14 microversion: 2.20 time: 0.112663 Dec 18 03:12:56.998376 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 47/98] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:12:56 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:58.008784 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-24fb565e-bd9d-4b2a-a96c-7b82a282a3f7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:58.009967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-24fb565e-bd9d-4b2a-a96c-7b82a282a3f7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:58.017057 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-24fb565e-bd9d-4b2a-a96c-7b82a282a3f7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:58.017509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-24fb565e-bd9d-4b2a-a96c-7b82a282a3f7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:58.018318 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-24fb565e-bd9d-4b2a-a96c-7b82a282a3f7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:58.018749 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-24fb565e-bd9d-4b2a-a96c-7b82a282a3f7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:58.132236 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-24fb565e-bd9d-4b2a-a96c-7b82a282a3f7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 14 microversion: 2.20 time: 0.127263 Dec 18 03:12:58.132902 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 52/99] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:12:58 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:12:59.143587 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-75d909ea-8dea-430a-9399-e65cdb5c756c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:12:59.144706 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-75d909ea-8dea-430a-9399-e65cdb5c756c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:12:59.151741 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75d909ea-8dea-430a-9399-e65cdb5c756c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:59.152247 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75d909ea-8dea-430a-9399-e65cdb5c756c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:12:59.153019 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75d909ea-8dea-430a-9399-e65cdb5c756c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:12:59.153454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75d909ea-8dea-430a-9399-e65cdb5c756c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:02.409640 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-75d909ea-8dea-430a-9399-e65cdb5c756c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 15064 microversion: 2.20 time: 3.269634 Dec 18 03:13:02.410338 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 48/100] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:12:59 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 15064 bytes in 3272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:03.420794 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f7c1faca-067b-41e7-bbba-d650a7c8db01 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:03.421830 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f7c1faca-067b-41e7-bbba-d650a7c8db01 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:03.428994 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f7c1faca-067b-41e7-bbba-d650a7c8db01 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:03.429470 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f7c1faca-067b-41e7-bbba-d650a7c8db01 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:03.430391 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f7c1faca-067b-41e7-bbba-d650a7c8db01 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:03.431377 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f7c1faca-067b-41e7-bbba-d650a7c8db01 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:03.541825 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f7c1faca-067b-41e7-bbba-d650a7c8db01 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 17861 microversion: 2.20 time: 0.123758 Dec 18 03:13:03.542808 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 53/101] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:03 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 17861 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:03.678598 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3ebd03aa-8573-416b-b1cd-6fc5c0052987 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:03.679218 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3ebd03aa-8573-416b-b1cd-6fc5c0052987 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:03.687435 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ebd03aa-8573-416b-b1cd-6fc5c0052987 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:03.687883 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ebd03aa-8573-416b-b1cd-6fc5c0052987 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:03.688669 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ebd03aa-8573-416b-b1cd-6fc5c0052987 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:03.689106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ebd03aa-8573-416b-b1cd-6fc5c0052987 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:03.716713 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3ebd03aa-8573-416b-b1cd-6fc5c0052987 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Going to try to terminate instance {{(pid=116000) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:13:03.816797 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3ebd03aa-8573-416b-b1cd-6fc5c0052987 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "DELETE /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 204 len: 0 microversion: 2.1 time: 0.141922 Dec 18 03:13:03.817643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 49/102] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:13:03 2021] DELETE /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:13:03.826653 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-69f52cea-2255-46b0-8759-e3f1db363c0f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:03.827448 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-69f52cea-2255-46b0-8759-e3f1db363c0f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:03.835237 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-69f52cea-2255-46b0-8759-e3f1db363c0f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:03.835688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-69f52cea-2255-46b0-8759-e3f1db363c0f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:03.836470 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-69f52cea-2255-46b0-8759-e3f1db363c0f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:03.836909 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-69f52cea-2255-46b0-8759-e3f1db363c0f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:04.001674 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-69f52cea-2255-46b0-8759-e3f1db363c0f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:04.009836 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-69f52cea-2255-46b0-8759-e3f1db363c0f tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1554 microversion: 2.1 time: 0.187725 Dec 18 03:13:04.010406 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 54/103] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:03 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:04.554760 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-73cfed0d-e7a9-4aa4-8bc7-3c915d31f4af tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:04.557008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-73cfed0d-e7a9-4aa4-8bc7-3c915d31f4af tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:04.562940 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73cfed0d-e7a9-4aa4-8bc7-3c915d31f4af tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:04.564095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73cfed0d-e7a9-4aa4-8bc7-3c915d31f4af tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:04.565074 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73cfed0d-e7a9-4aa4-8bc7-3c915d31f4af tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:04.565680 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73cfed0d-e7a9-4aa4-8bc7-3c915d31f4af tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:05.031762 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7059b81f-0516-429b-baae-f2c0a0475638 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:05.032339 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7059b81f-0516-429b-baae-f2c0a0475638 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:05.043688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7059b81f-0516-429b-baae-f2c0a0475638 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:05.044525 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7059b81f-0516-429b-baae-f2c0a0475638 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:05.045555 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7059b81f-0516-429b-baae-f2c0a0475638 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:05.046208 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7059b81f-0516-429b-baae-f2c0a0475638 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:05.268108 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7059b81f-0516-429b-baae-f2c0a0475638 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:05.276885 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7059b81f-0516-429b-baae-f2c0a0475638 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1554 microversion: 2.1 time: 0.253834 Dec 18 03:13:05.296434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 55/104] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:05 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1554 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:06.295906 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8cb47169-b205-4ec2-a12b-af9c3177a06c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:06.296524 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8cb47169-b205-4ec2-a12b-af9c3177a06c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:06.304029 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cb47169-b205-4ec2-a12b-af9c3177a06c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:06.304459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cb47169-b205-4ec2-a12b-af9c3177a06c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:06.305471 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cb47169-b205-4ec2-a12b-af9c3177a06c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:06.306861 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cb47169-b205-4ec2-a12b-af9c3177a06c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:06.518952 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8cb47169-b205-4ec2-a12b-af9c3177a06c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:06.527994 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8cb47169-b205-4ec2-a12b-af9c3177a06c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1554 microversion: 2.1 time: 0.238015 Dec 18 03:13:06.528496 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 56/105] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:06 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:07.306287 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-73cfed0d-e7a9-4aa4-8bc7-3c915d31f4af tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 23234 microversion: 2.20 time: 2.754957 Dec 18 03:13:07.307822 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 50/106] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:04 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 23234 bytes in 2759 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:07.544938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e7ab4dea-ac7c-4785-bcc8-edfaffefca19 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:07.545474 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e7ab4dea-ac7c-4785-bcc8-edfaffefca19 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:07.551848 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e7ab4dea-ac7c-4785-bcc8-edfaffefca19 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:07.552293 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e7ab4dea-ac7c-4785-bcc8-edfaffefca19 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:07.553326 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e7ab4dea-ac7c-4785-bcc8-edfaffefca19 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:07.553970 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e7ab4dea-ac7c-4785-bcc8-edfaffefca19 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:07.756316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e7ab4dea-ac7c-4785-bcc8-edfaffefca19 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:07.765533 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e7ab4dea-ac7c-4785-bcc8-edfaffefca19 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1554 microversion: 2.1 time: 0.224986 Dec 18 03:13:07.766530 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 57/107] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:07 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:08.319766 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3c5ce527-d53e-4fd6-a217-a0fafd45876a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:08.320768 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3c5ce527-d53e-4fd6-a217-a0fafd45876a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:08.328944 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c5ce527-d53e-4fd6-a217-a0fafd45876a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:08.329628 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c5ce527-d53e-4fd6-a217-a0fafd45876a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:08.330411 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c5ce527-d53e-4fd6-a217-a0fafd45876a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:08.330984 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c5ce527-d53e-4fd6-a217-a0fafd45876a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:08.453497 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3c5ce527-d53e-4fd6-a217-a0fafd45876a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 24474 microversion: 2.20 time: 0.137316 Dec 18 03:13:08.454907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 51/108] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:08 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 24474 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:08.784459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-dd858b7e-f21a-4b1a-89d7-a5a0b41e82a1 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:08.785060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-dd858b7e-f21a-4b1a-89d7-a5a0b41e82a1 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:08.791343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dd858b7e-f21a-4b1a-89d7-a5a0b41e82a1 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:08.791779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dd858b7e-f21a-4b1a-89d7-a5a0b41e82a1 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:08.792904 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dd858b7e-f21a-4b1a-89d7-a5a0b41e82a1 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:08.793337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dd858b7e-f21a-4b1a-89d7-a5a0b41e82a1 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:08.923641 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-dd858b7e-f21a-4b1a-89d7-a5a0b41e82a1 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:08.932151 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-dd858b7e-f21a-4b1a-89d7-a5a0b41e82a1 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1554 microversion: 2.1 time: 0.151152 Dec 18 03:13:08.932735 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 58/109] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:08 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:09.467146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1829e063-51bd-4ff0-8c51-0d72f23461e6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:09.468152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1829e063-51bd-4ff0-8c51-0d72f23461e6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:09.474930 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1829e063-51bd-4ff0-8c51-0d72f23461e6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:09.475376 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1829e063-51bd-4ff0-8c51-0d72f23461e6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:09.476150 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1829e063-51bd-4ff0-8c51-0d72f23461e6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:09.476586 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1829e063-51bd-4ff0-8c51-0d72f23461e6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:09.949053 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d4401005-5cf2-4f33-8832-e48de16b2893 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:09.949681 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d4401005-5cf2-4f33-8832-e48de16b2893 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:09.955932 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4401005-5cf2-4f33-8832-e48de16b2893 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:09.956375 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4401005-5cf2-4f33-8832-e48de16b2893 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:09.957151 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4401005-5cf2-4f33-8832-e48de16b2893 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:09.957586 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4401005-5cf2-4f33-8832-e48de16b2893 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:10.085595 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d4401005-5cf2-4f33-8832-e48de16b2893 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:10.093897 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d4401005-5cf2-4f33-8832-e48de16b2893 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1554 microversion: 2.1 time: 0.149040 Dec 18 03:13:10.094457 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 59/110] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:09 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:11.111180 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7c2a6697-dd3a-4c34-9dcd-149b0626b23c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:11.111804 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7c2a6697-dd3a-4c34-9dcd-149b0626b23c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:11.118728 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7c2a6697-dd3a-4c34-9dcd-149b0626b23c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:11.119341 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7c2a6697-dd3a-4c34-9dcd-149b0626b23c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:11.120637 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7c2a6697-dd3a-4c34-9dcd-149b0626b23c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:11.120637 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7c2a6697-dd3a-4c34-9dcd-149b0626b23c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:11.245959 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7c2a6697-dd3a-4c34-9dcd-149b0626b23c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:11.253780 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7c2a6697-dd3a-4c34-9dcd-149b0626b23c tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1554 microversion: 2.1 time: 0.146187 Dec 18 03:13:11.254370 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 60/111] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:11 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:11.688316 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1829e063-51bd-4ff0-8c51-0d72f23461e6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 27026 microversion: 2.20 time: 2.225173 Dec 18 03:13:11.689248 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 52/112] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:09 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 27026 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:12.270638 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9fdb4b82-5283-48e2-9e21-8fb9d2858d1b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:12.271260 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9fdb4b82-5283-48e2-9e21-8fb9d2858d1b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:12.277562 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9fdb4b82-5283-48e2-9e21-8fb9d2858d1b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:12.278038 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9fdb4b82-5283-48e2-9e21-8fb9d2858d1b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:12.278969 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9fdb4b82-5283-48e2-9e21-8fb9d2858d1b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:12.279404 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9fdb4b82-5283-48e2-9e21-8fb9d2858d1b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:12.505901 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9fdb4b82-5283-48e2-9e21-8fb9d2858d1b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:12.516013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9fdb4b82-5283-48e2-9e21-8fb9d2858d1b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1554 microversion: 2.1 time: 0.249198 Dec 18 03:13:12.524838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 61/113] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:12 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1554 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:12.702970 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-b09a7e4a-f480-42f5-91db-9f7b3bcd1f25 req-d29fb906-06b2-42cc-bf19-afbafe865051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e00542-7c0f-4f71-911f-b0b3a6d4c599", "name": "network-vif-deleted", "tag": "e9a28560-c549-4e92-8993-34d623482c10"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:12.704597 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:12.704597 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:13:12.711062 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5b95f9ab-4a09-43a6-b495-2238065b5194 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:12.711512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-b09a7e4a-f480-42f5-91db-9f7b3bcd1f25 req-d29fb906-06b2-42cc-bf19-afbafe865051 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:12.712535 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-b09a7e4a-f480-42f5-91db-9f7b3bcd1f25 req-d29fb906-06b2-42cc-bf19-afbafe865051 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:12.712713 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5b95f9ab-4a09-43a6-b495-2238065b5194 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:12.719952 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b95f9ab-4a09-43a6-b495-2238065b5194 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:12.720395 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b95f9ab-4a09-43a6-b495-2238065b5194 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:12.721180 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b95f9ab-4a09-43a6-b495-2238065b5194 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:12.721611 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b95f9ab-4a09-43a6-b495-2238065b5194 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:12.723884 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-b09a7e4a-f480-42f5-91db-9f7b3bcd1f25 req-d29fb906-06b2-42cc-bf19-afbafe865051 service nova] Creating event network-vif-deleted:e9a28560-c549-4e92-8993-34d623482c10 for instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 on hv-cinder-81803 Dec 18 03:13:12.729132 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-b09a7e4a-f480-42f5-91db-9f7b3bcd1f25 req-d29fb906-06b2-42cc-bf19-afbafe865051 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029655 Dec 18 03:13:12.730487 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 62/114] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:13:13.541787 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0f707d4f-27e5-4c52-b731-e85ce41e4735 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:13.542488 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0f707d4f-27e5-4c52-b731-e85ce41e4735 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:13.548496 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0f707d4f-27e5-4c52-b731-e85ce41e4735 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:13.548944 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0f707d4f-27e5-4c52-b731-e85ce41e4735 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:13.549778 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0f707d4f-27e5-4c52-b731-e85ce41e4735 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:13.550211 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0f707d4f-27e5-4c52-b731-e85ce41e4735 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:13.612237 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0f707d4f-27e5-4c52-b731-e85ce41e4735 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:13.620433 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0f707d4f-27e5-4c52-b731-e85ce41e4735 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1512 microversion: 2.1 time: 0.083356 Dec 18 03:13:13.620983 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 63/115] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:13 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1512 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:14.638290 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c5ff8dff-663f-4b88-9954-626aef9d7c76 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:14.638904 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c5ff8dff-663f-4b88-9954-626aef9d7c76 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:14.645013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5ff8dff-663f-4b88-9954-626aef9d7c76 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:14.645461 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5ff8dff-663f-4b88-9954-626aef9d7c76 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:14.646301 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5ff8dff-663f-4b88-9954-626aef9d7c76 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:14.646734 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5ff8dff-663f-4b88-9954-626aef9d7c76 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:14.705817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c5ff8dff-663f-4b88-9954-626aef9d7c76 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:14.714368 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c5ff8dff-663f-4b88-9954-626aef9d7c76 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1512 microversion: 2.1 time: 0.079627 Dec 18 03:13:14.714923 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 64/116] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:14 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1512 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:15.377461 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5b95f9ab-4a09-43a6-b495-2238065b5194 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 27831 microversion: 2.20 time: 2.680052 Dec 18 03:13:15.378171 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 53/117] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:12 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 27831 bytes in 2682 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:13:15.731259 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-91b154b1-247a-4635-9974-e0b9896865fb tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:15.732157 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-91b154b1-247a-4635-9974-e0b9896865fb tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:15.739943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-91b154b1-247a-4635-9974-e0b9896865fb tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:15.740387 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-91b154b1-247a-4635-9974-e0b9896865fb tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:15.741168 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-91b154b1-247a-4635-9974-e0b9896865fb tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:15.741598 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-91b154b1-247a-4635-9974-e0b9896865fb tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:15.803900 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-91b154b1-247a-4635-9974-e0b9896865fb tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:15.812177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-91b154b1-247a-4635-9974-e0b9896865fb tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1346 microversion: 2.1 time: 0.085307 Dec 18 03:13:15.819177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 65/118] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:15 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:16.389172 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8f8f7822-ed41-400e-bf81-78ce2a937c6a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:16.390391 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8f8f7822-ed41-400e-bf81-78ce2a937c6a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:16.405426 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f8f7822-ed41-400e-bf81-78ce2a937c6a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:16.405902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f8f7822-ed41-400e-bf81-78ce2a937c6a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:16.406690 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f8f7822-ed41-400e-bf81-78ce2a937c6a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:16.407120 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f8f7822-ed41-400e-bf81-78ce2a937c6a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:16.536493 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8f8f7822-ed41-400e-bf81-78ce2a937c6a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28193 microversion: 2.20 time: 0.151295 Dec 18 03:13:16.541117 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 54/119] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:16 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28193 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:16.827943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:16.828977 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:16.835370 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:16.835810 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:16.836609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:16.837036 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:16.881451 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:16.881924 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:16.882392 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lazy-loading 'fault' on Instance uuid 27e00542-7c0f-4f71-911f-b0b3a6d4c599 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:13:16.945680 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800bdf7105074aac90836d4bbcc483b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6b1669a90f442992fb339de8e51e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:16.960221 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9a7bbb3a-8e99-4f41-9dee-9bbba92970c8 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 200 len: 1351 microversion: 2.1 time: 0.135767 Dec 18 03:13:16.961078 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 66/120] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:16 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 1351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:17.094276 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-732128660", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "networks": [{"uuid": "1d8dfc79-d3fb-4837-9660-6625a84f5064"}]}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:17.176723 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] validate_networks() for [('1d8dfc79-d3fb-4837-9660-6625a84f5064', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:13:17.549122 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f3f22905-dbf3-4b18-9e2a-d6b367f2cfb2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:17.550759 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f3f22905-dbf3-4b18-9e2a-d6b367f2cfb2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:17.557530 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3f22905-dbf3-4b18-9e2a-d6b367f2cfb2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:17.558458 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3f22905-dbf3-4b18-9e2a-d6b367f2cfb2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:17.559418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3f22905-dbf3-4b18-9e2a-d6b367f2cfb2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:17.560352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3f22905-dbf3-4b18-9e2a-d6b367f2cfb2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:17.577152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:13:17.577613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:13:17.578241 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:13:17.578723 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:13:17.579132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:13:17.594993 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:17.595609 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:17.596608 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:17.597044 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:17.622814 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Getting quotas for project e04a810a1bed41eb90634777ccbde0f4. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:13:17.627638 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Getting quotas for user 208a33c69dc44f399bac2a34bc018ef1 and project e04a810a1bed41eb90634777ccbde0f4. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:13:17.641179 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:13:17.644166 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:13:17.690832 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f3f22905-dbf3-4b18-9e2a-d6b367f2cfb2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28193 microversion: 2.20 time: 0.145405 Dec 18 03:13:17.697290 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 67/121] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:17 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28193 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:13:17.717309 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3f737625-dac5-4bf0-9824-06cae2e57136 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627582 Dec 18 03:13:17.718608 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 55/122] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:13:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:13:17.728817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-60a279bd-aeb2-4511-bd9c-5d6c4b6b4e95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:17.731038 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-60a279bd-aeb2-4511-bd9c-5d6c4b6b4e95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:17.811815 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-60a279bd-aeb2-4511-bd9c-5d6c4b6b4e95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:17.824307 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-60a279bd-aeb2-4511-bd9c-5d6c4b6b4e95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1217 microversion: 2.1 time: 0.099860 Dec 18 03:13:17.825418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 68/123] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:17 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:17.978755 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-729be508-256a-44b4-82c2-6491ff0e5cbf tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:17.982768 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-729be508-256a-44b4-82c2-6491ff0e5cbf tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:18.000246 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-729be508-256a-44b4-82c2-6491ff0e5cbf tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:18.000868 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-729be508-256a-44b4-82c2-6491ff0e5cbf tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:18.002008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-729be508-256a-44b4-82c2-6491ff0e5cbf tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:18.002583 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-729be508-256a-44b4-82c2-6491ff0e5cbf tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:18.031026 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-729be508-256a-44b4-82c2-6491ff0e5cbf tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] HTTP exception thrown: Instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 could not be found. Dec 18 03:13:18.031616 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-729be508-256a-44b4-82c2-6491ff0e5cbf tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Returning 404 to user: Instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:13:18.032440 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-729be508-256a-44b4-82c2-6491ff0e5cbf tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 404 len: 111 microversion: 2.1 time: 0.058692 Dec 18 03:13:18.035888 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 56/124] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:17 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:13:18.309851 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e8152ed2-1c24-4cff-a31a-eea0925a624a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:18.310963 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e8152ed2-1c24-4cff-a31a-eea0925a624a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:18.318360 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8152ed2-1c24-4cff-a31a-eea0925a624a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:18.319269 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8152ed2-1c24-4cff-a31a-eea0925a624a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:18.320244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8152ed2-1c24-4cff-a31a-eea0925a624a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:18.320939 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8152ed2-1c24-4cff-a31a-eea0925a624a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:18.353258 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-e8152ed2-1c24-4cff-a31a-eea0925a624a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] HTTP exception thrown: Instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 could not be found. Dec 18 03:13:18.353884 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e8152ed2-1c24-4cff-a31a-eea0925a624a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Returning 404 to user: Instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:13:18.356598 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e8152ed2-1c24-4cff-a31a-eea0925a624a tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051238 Dec 18 03:13:18.360708 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 69/125] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:13:18 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:13:18.706533 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ecb95cf4-9c93-4d54-9b01-480e3227fc96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:18.707682 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ecb95cf4-9c93-4d54-9b01-480e3227fc96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:18.716005 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ecb95cf4-9c93-4d54-9b01-480e3227fc96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:18.716455 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ecb95cf4-9c93-4d54-9b01-480e3227fc96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:18.717248 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ecb95cf4-9c93-4d54-9b01-480e3227fc96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:18.717708 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ecb95cf4-9c93-4d54-9b01-480e3227fc96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:18.843185 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5297ea3a-2ad2-44a1-b82a-322724a98d77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:18.844042 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5297ea3a-2ad2-44a1-b82a-322724a98d77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:18.853341 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5297ea3a-2ad2-44a1-b82a-322724a98d77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:18.854374 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5297ea3a-2ad2-44a1-b82a-322724a98d77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:18.855787 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5297ea3a-2ad2-44a1-b82a-322724a98d77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:18.861923 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5297ea3a-2ad2-44a1-b82a-322724a98d77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:18.942605 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5297ea3a-2ad2-44a1-b82a-322724a98d77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:18.951481 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5297ea3a-2ad2-44a1-b82a-322724a98d77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1221 microversion: 2.1 time: 0.111963 Dec 18 03:13:18.952730 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 70/126] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:18 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:19.969322 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-82db4ed3-93f9-4462-a790-8330518c07db tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:19.970041 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-82db4ed3-93f9-4462-a790-8330518c07db tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:19.979996 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-82db4ed3-93f9-4462-a790-8330518c07db tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:19.980922 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-82db4ed3-93f9-4462-a790-8330518c07db tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:19.982560 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-82db4ed3-93f9-4462-a790-8330518c07db tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:19.983073 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-82db4ed3-93f9-4462-a790-8330518c07db tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:20.064931 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-82db4ed3-93f9-4462-a790-8330518c07db tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:20.073140 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-82db4ed3-93f9-4462-a790-8330518c07db tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1221 microversion: 2.1 time: 0.108437 Dec 18 03:13:20.074146 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 71/127] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:19 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:20.992152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ecb95cf4-9c93-4d54-9b01-480e3227fc96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28193 microversion: 2.20 time: 2.290583 Dec 18 03:13:20.994121 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 57/128] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:18 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28193 bytes in 2294 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:21.089731 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-938f3e51-add8-4648-a720-337879f28469 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:21.090427 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-938f3e51-add8-4648-a720-337879f28469 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:21.096886 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-938f3e51-add8-4648-a720-337879f28469 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:21.097423 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-938f3e51-add8-4648-a720-337879f28469 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:21.098434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-938f3e51-add8-4648-a720-337879f28469 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:21.098935 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-938f3e51-add8-4648-a720-337879f28469 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:21.380412 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-938f3e51-add8-4648-a720-337879f28469 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:21.388343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-938f3e51-add8-4648-a720-337879f28469 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1213 microversion: 2.1 time: 0.302245 Dec 18 03:13:21.389212 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 72/129] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:21 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1213 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:22.007909 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6b7a8059-6942-43dd-9ef7-607e8d840550 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:22.009003 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6b7a8059-6942-43dd-9ef7-607e8d840550 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:22.019250 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b7a8059-6942-43dd-9ef7-607e8d840550 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:22.019250 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b7a8059-6942-43dd-9ef7-607e8d840550 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:22.019250 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b7a8059-6942-43dd-9ef7-607e8d840550 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:22.019250 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b7a8059-6942-43dd-9ef7-607e8d840550 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:22.132750 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6b7a8059-6942-43dd-9ef7-607e8d840550 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28193 microversion: 2.20 time: 0.129739 Dec 18 03:13:22.134806 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 58/130] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:22 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28193 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:22.405933 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bd79555a-1369-4d27-b774-6a36a6bcd2d9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:22.407563 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bd79555a-1369-4d27-b774-6a36a6bcd2d9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:22.421240 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bd79555a-1369-4d27-b774-6a36a6bcd2d9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:22.425986 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bd79555a-1369-4d27-b774-6a36a6bcd2d9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:22.426834 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bd79555a-1369-4d27-b774-6a36a6bcd2d9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:22.427365 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bd79555a-1369-4d27-b774-6a36a6bcd2d9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:22.589506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bd79555a-1369-4d27-b774-6a36a6bcd2d9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:22.596931 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bd79555a-1369-4d27-b774-6a36a6bcd2d9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.194706 Dec 18 03:13:22.597497 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 73/131] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:22 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:22.885791 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f7bee314-78df-42a0-b53f-8e08aa4012b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:22.886398 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f7bee314-78df-42a0-b53f-8e08aa4012b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:22.893124 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f7bee314-78df-42a0-b53f-8e08aa4012b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:22.893561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f7bee314-78df-42a0-b53f-8e08aa4012b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:22.894351 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f7bee314-78df-42a0-b53f-8e08aa4012b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:22.894852 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f7bee314-78df-42a0-b53f-8e08aa4012b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:22.909064 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-f7bee314-78df-42a0-b53f-8e08aa4012b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] HTTP exception thrown: Instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 could not be found. Dec 18 03:13:22.909643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f7bee314-78df-42a0-b53f-8e08aa4012b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Returning 404 to user: Instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:13:22.910450 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f7bee314-78df-42a0-b53f-8e08aa4012b6 tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "DELETE /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 404 len: 111 microversion: 2.1 time: 0.028733 Dec 18 03:13:22.910963 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 59/132] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:13:22 2021] DELETE /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:13:22.919148 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c96a2f4a-8637-4cfa-9c4c-7ad6d963363b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:22.919787 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c96a2f4a-8637-4cfa-9c4c-7ad6d963363b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] [instance: 27e00542-7c0f-4f71-911f-b0b3a6d4c599] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:22.925540 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c96a2f4a-8637-4cfa-9c4c-7ad6d963363b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:22.926016 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c96a2f4a-8637-4cfa-9c4c-7ad6d963363b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:22.926779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c96a2f4a-8637-4cfa-9c4c-7ad6d963363b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:22.927206 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c96a2f4a-8637-4cfa-9c4c-7ad6d963363b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:22.940712 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-c96a2f4a-8637-4cfa-9c4c-7ad6d963363b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] HTTP exception thrown: Instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 could not be found. Dec 18 03:13:22.941279 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c96a2f4a-8637-4cfa-9c4c-7ad6d963363b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] Returning 404 to user: Instance 27e00542-7c0f-4f71-911f-b0b3a6d4c599 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:13:22.942107 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c96a2f4a-8637-4cfa-9c4c-7ad6d963363b tempest-DeleteServersTestJSON-287230484 tempest-DeleteServersTestJSON-287230484-project] 10.222.0.24 "GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599" status: 404 len: 111 microversion: 2.1 time: 0.026596 Dec 18 03:13:22.942605 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 74/133] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:22 2021] GET /compute/v2.1/servers/27e00542-7c0f-4f71-911f-b0b3a6d4c599 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:13:23.147381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-86d1d665-ccbc-4b6a-9cd5-1ba1d61b5b12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:23.148295 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-86d1d665-ccbc-4b6a-9cd5-1ba1d61b5b12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:23.159680 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86d1d665-ccbc-4b6a-9cd5-1ba1d61b5b12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:23.166128 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86d1d665-ccbc-4b6a-9cd5-1ba1d61b5b12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:23.166953 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86d1d665-ccbc-4b6a-9cd5-1ba1d61b5b12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:23.167386 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86d1d665-ccbc-4b6a-9cd5-1ba1d61b5b12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:23.614910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3d725710-28dd-4717-9099-743b779bdc2d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:23.615523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3d725710-28dd-4717-9099-743b779bdc2d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:23.621867 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d725710-28dd-4717-9099-743b779bdc2d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:23.622316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d725710-28dd-4717-9099-743b779bdc2d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:23.623093 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d725710-28dd-4717-9099-743b779bdc2d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:23.623527 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d725710-28dd-4717-9099-743b779bdc2d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:23.823949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3d725710-28dd-4717-9099-743b779bdc2d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:23.831289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3d725710-28dd-4717-9099-743b779bdc2d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.220097 Dec 18 03:13:23.831930 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 75/134] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:23 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:24.848324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-eb3ef3df-0abb-43bc-ae08-1b67d4d7d26b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:24.848991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-eb3ef3df-0abb-43bc-ae08-1b67d4d7d26b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:24.856029 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eb3ef3df-0abb-43bc-ae08-1b67d4d7d26b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:24.856446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eb3ef3df-0abb-43bc-ae08-1b67d4d7d26b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:24.857398 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eb3ef3df-0abb-43bc-ae08-1b67d4d7d26b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:24.857865 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eb3ef3df-0abb-43bc-ae08-1b67d4d7d26b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:25.009706 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-eb3ef3df-0abb-43bc-ae08-1b67d4d7d26b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:25.016899 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-eb3ef3df-0abb-43bc-ae08-1b67d4d7d26b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.172228 Dec 18 03:13:25.017462 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 76/135] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:24 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:25.248022 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-86d1d665-ccbc-4b6a-9cd5-1ba1d61b5b12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28208 microversion: 2.20 time: 2.104591 Dec 18 03:13:25.251876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 60/136] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:23 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28208 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:25.837831 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-b893484b-4aba-429f-b96f-39ed96b505f9 req-0c0e5cae-a8bc-45a6-bd7b-43a3949e32ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c1697d-abd6-44f6-b11e-e6407b595fa9", "tag": "01a67308-4fa3-4c17-9106-2b102610d2fe"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:25.841234 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:25.841234 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:13:25.851600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-b893484b-4aba-429f-b96f-39ed96b505f9 req-0c0e5cae-a8bc-45a6-bd7b-43a3949e32ca service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:25.852436 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-b893484b-4aba-429f-b96f-39ed96b505f9 req-0c0e5cae-a8bc-45a6-bd7b-43a3949e32ca service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:25.864738 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-b893484b-4aba-429f-b96f-39ed96b505f9 req-0c0e5cae-a8bc-45a6-bd7b-43a3949e32ca service nova] Creating event network-changed:01a67308-4fa3-4c17-9106-2b102610d2fe for instance 49c1697d-abd6-44f6-b11e-e6407b595fa9 on hv-cinder-81803 Dec 18 03:13:25.870732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-b893484b-4aba-429f-b96f-39ed96b505f9 req-0c0e5cae-a8bc-45a6-bd7b-43a3949e32ca service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039684 Dec 18 03:13:25.871326 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 77/137] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:13:26.034952 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5610d0ab-acbd-4701-b05b-07c8111c0a47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:26.035683 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5610d0ab-acbd-4701-b05b-07c8111c0a47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:26.043552 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5610d0ab-acbd-4701-b05b-07c8111c0a47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:26.044077 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5610d0ab-acbd-4701-b05b-07c8111c0a47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:26.044933 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5610d0ab-acbd-4701-b05b-07c8111c0a47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:26.045586 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5610d0ab-acbd-4701-b05b-07c8111c0a47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:26.201770 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5610d0ab-acbd-4701-b05b-07c8111c0a47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:26.213560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5610d0ab-acbd-4701-b05b-07c8111c0a47 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.182728 Dec 18 03:13:26.214501 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 61/138] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:26 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:26.260298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-fcec7623-a4df-4dcf-afed-7428e53437f3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:26.261633 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-fcec7623-a4df-4dcf-afed-7428e53437f3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:26.267779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcec7623-a4df-4dcf-afed-7428e53437f3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:26.268342 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcec7623-a4df-4dcf-afed-7428e53437f3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:26.269248 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcec7623-a4df-4dcf-afed-7428e53437f3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:26.269817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcec7623-a4df-4dcf-afed-7428e53437f3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:27.231419 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-53c47e9e-ef42-4c85-936a-c13516c07220 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:27.232057 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-53c47e9e-ef42-4c85-936a-c13516c07220 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:27.239037 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-53c47e9e-ef42-4c85-936a-c13516c07220 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:27.239483 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-53c47e9e-ef42-4c85-936a-c13516c07220 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:27.240447 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-53c47e9e-ef42-4c85-936a-c13516c07220 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:27.240879 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-53c47e9e-ef42-4c85-936a-c13516c07220 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:27.464047 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-53c47e9e-ef42-4c85-936a-c13516c07220 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:27.471928 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-53c47e9e-ef42-4c85-936a-c13516c07220 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.244904 Dec 18 03:13:27.472688 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 62/139] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:27 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:28.489375 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ce3e45f7-3960-48c2-951d-a36ec7847982 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:28.490041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ce3e45f7-3960-48c2-951d-a36ec7847982 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:28.497130 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ce3e45f7-3960-48c2-951d-a36ec7847982 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:28.497584 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ce3e45f7-3960-48c2-951d-a36ec7847982 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:28.498415 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ce3e45f7-3960-48c2-951d-a36ec7847982 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:28.498852 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ce3e45f7-3960-48c2-951d-a36ec7847982 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:28.687390 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-fcec7623-a4df-4dcf-afed-7428e53437f3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28482 microversion: 2.20 time: 2.431463 Dec 18 03:13:28.688478 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 78/140] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:26 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28482 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:28.848242 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ce3e45f7-3960-48c2-951d-a36ec7847982 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:28.857707 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ce3e45f7-3960-48c2-951d-a36ec7847982 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.371710 Dec 18 03:13:28.858961 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 63/141] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:28 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:29.467182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-197453046", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8b9d0cf-2f4c-4312-853d-a35b9e139535"}]}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:29.519500 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] validate_networks() for [('b8b9d0cf-2f4c-4312-853d-a35b9e139535', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:13:29.698831 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e7ed3f67-ad41-427b-a9e8-51c86741d302 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:29.699841 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e7ed3f67-ad41-427b-a9e8-51c86741d302 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:29.714240 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e7ed3f67-ad41-427b-a9e8-51c86741d302 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:29.714725 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e7ed3f67-ad41-427b-a9e8-51c86741d302 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:29.715536 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e7ed3f67-ad41-427b-a9e8-51c86741d302 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:29.715972 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e7ed3f67-ad41-427b-a9e8-51c86741d302 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:29.975980 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:13:29.976467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:13:29.977526 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:13:29.978107 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:13:29.978861 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:13:29.993058 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:29.993841 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:29.994666 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:29.995098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:30.018579 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Getting quotas for project 502652af86344b828a769149c2964636. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:13:30.023007 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Getting quotas for user 52e7790b3fa743b084df1079d1916138 and project 502652af86344b828a769149c2964636. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:13:30.034898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:13:30.037553 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:13:30.104398 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3cb082c6-e396-485f-8f46-fdc00b63b0aa tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.749485 Dec 18 03:13:30.105378 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 79/142] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:13:29 2021] POST /compute/v2.1/servers => generated 383 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:13:30.121963 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5ecbed10-d051-4079-9ec2-3af5b04886af tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:30.133831 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5ecbed10-d051-4079-9ec2-3af5b04886af tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:30.163087 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5ecbed10-d051-4079-9ec2-3af5b04886af tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:30.169744 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5ecbed10-d051-4079-9ec2-3af5b04886af tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:30.170793 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5ecbed10-d051-4079-9ec2-3af5b04886af tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:30.171360 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5ecbed10-d051-4079-9ec2-3af5b04886af tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:30.357766 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5ecbed10-d051-4079-9ec2-3af5b04886af tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:30.366906 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5ecbed10-d051-4079-9ec2-3af5b04886af tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.260121 Dec 18 03:13:30.368349 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 80/143] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:30 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:30.383596 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e041f68f-2b3c-4f77-90a0-6a4490cc4b42 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:30.384318 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e041f68f-2b3c-4f77-90a0-6a4490cc4b42 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:30.454037 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e041f68f-2b3c-4f77-90a0-6a4490cc4b42 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:30.463910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e041f68f-2b3c-4f77-90a0-6a4490cc4b42 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1221 microversion: 2.1 time: 0.085557 Dec 18 03:13:30.465013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 81/144] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:30 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:30.521441 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2049708715", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8b9d0cf-2f4c-4312-853d-a35b9e139535"}]}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:30.577813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] validate_networks() for [('b8b9d0cf-2f4c-4312-853d-a35b9e139535', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:13:30.951690 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:13:30.952214 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:13:30.953041 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:13:30.953568 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:13:30.954275 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:13:30.964545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:30.965276 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:30.966365 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:30.966895 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:30.984157 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Getting quotas for project 502652af86344b828a769149c2964636. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:13:30.988617 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Getting quotas for user 52e7790b3fa743b084df1079d1916138 and project 502652af86344b828a769149c2964636. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:13:31.001493 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:13:31.003761 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:13:31.051324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1f77b2e5-94f1-48a5-b5c7-d7fd495ff5eb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.533749 Dec 18 03:13:31.052318 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 82/145] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:13:30 2021] POST /compute/v2.1/servers => generated 383 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 03:13:31.061450 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2a0dd7bc-c03c-40e4-9fd4-c8d8c255eb2d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:31.062087 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2a0dd7bc-c03c-40e4-9fd4-c8d8c255eb2d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:31.129607 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2a0dd7bc-c03c-40e4-9fd4-c8d8c255eb2d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:31.136876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2a0dd7bc-c03c-40e4-9fd4-c8d8c255eb2d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1222 microversion: 2.1 time: 0.078849 Dec 18 03:13:31.141671 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 83/146] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:31 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:31.384453 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e5757d02-86b2-45a2-8d54-e20a6ab8e47a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:31.385191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e5757d02-86b2-45a2-8d54-e20a6ab8e47a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:31.391821 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e5757d02-86b2-45a2-8d54-e20a6ab8e47a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:31.392389 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e5757d02-86b2-45a2-8d54-e20a6ab8e47a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:31.393385 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e5757d02-86b2-45a2-8d54-e20a6ab8e47a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:31.394063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e5757d02-86b2-45a2-8d54-e20a6ab8e47a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:31.553865 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e5757d02-86b2-45a2-8d54-e20a6ab8e47a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:31.561698 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e5757d02-86b2-45a2-8d54-e20a6ab8e47a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.181073 Dec 18 03:13:31.562546 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 84/147] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:31 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:31.843371 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e7ed3f67-ad41-427b-a9e8-51c86741d302 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28664 microversion: 2.20 time: 2.148622 Dec 18 03:13:31.844051 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 64/148] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:29 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28664 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:13:32.155020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-27aa0bfb-0fbe-4466-a169-1b6260217158 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:32.156308 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-27aa0bfb-0fbe-4466-a169-1b6260217158 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:32.172285 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-27aa0bfb-0fbe-4466-a169-1b6260217158 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:32.173193 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-27aa0bfb-0fbe-4466-a169-1b6260217158 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:32.174219 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-27aa0bfb-0fbe-4466-a169-1b6260217158 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:32.175029 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-27aa0bfb-0fbe-4466-a169-1b6260217158 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:32.278787 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-27aa0bfb-0fbe-4466-a169-1b6260217158 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:32.292297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-27aa0bfb-0fbe-4466-a169-1b6260217158 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1218 microversion: 2.1 time: 0.140917 Dec 18 03:13:32.293580 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 85/149] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:32 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:32.581860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fda7bae8-f85f-4250-aef7-dfbc802057e4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:32.582583 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-fda7bae8-f85f-4250-aef7-dfbc802057e4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:32.596845 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fda7bae8-f85f-4250-aef7-dfbc802057e4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:32.602062 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fda7bae8-f85f-4250-aef7-dfbc802057e4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:32.603989 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fda7bae8-f85f-4250-aef7-dfbc802057e4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:32.604503 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fda7bae8-f85f-4250-aef7-dfbc802057e4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:32.856210 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-cdd80256-d800-4c06-b9e6-46c3f9dc2a07 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:32.857205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-cdd80256-d800-4c06-b9e6-46c3f9dc2a07 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:32.860642 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-fda7bae8-f85f-4250-aef7-dfbc802057e4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:32.871244 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-fda7bae8-f85f-4250-aef7-dfbc802057e4 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.294958 Dec 18 03:13:32.871851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 65/150] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:32 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:32.880538 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cdd80256-d800-4c06-b9e6-46c3f9dc2a07 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:32.881311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cdd80256-d800-4c06-b9e6-46c3f9dc2a07 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:32.882633 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cdd80256-d800-4c06-b9e6-46c3f9dc2a07 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:32.883733 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cdd80256-d800-4c06-b9e6-46c3f9dc2a07 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:33.008860 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-cdd80256-d800-4c06-b9e6-46c3f9dc2a07 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28834 microversion: 2.20 time: 0.157324 Dec 18 03:13:33.009575 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 86/151] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:32 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28834 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:13:33.311805 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f2584c80-e1d2-49be-9177-f86b3fde69bd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:33.312912 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f2584c80-e1d2-49be-9177-f86b3fde69bd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:33.321671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f2584c80-e1d2-49be-9177-f86b3fde69bd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:33.322284 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f2584c80-e1d2-49be-9177-f86b3fde69bd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:33.323384 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f2584c80-e1d2-49be-9177-f86b3fde69bd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:33.324103 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f2584c80-e1d2-49be-9177-f86b3fde69bd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:33.461930 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f2584c80-e1d2-49be-9177-f86b3fde69bd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:33.473334 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f2584c80-e1d2-49be-9177-f86b3fde69bd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1282 microversion: 2.1 time: 0.166319 Dec 18 03:13:33.473995 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 66/152] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:33 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:33.893597 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d75325ef-8278-4f8c-b284-f82586f5f3ed tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:33.895165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d75325ef-8278-4f8c-b284-f82586f5f3ed tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:33.904319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d75325ef-8278-4f8c-b284-f82586f5f3ed tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:33.906639 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d75325ef-8278-4f8c-b284-f82586f5f3ed tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:33.907966 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d75325ef-8278-4f8c-b284-f82586f5f3ed tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:33.908554 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d75325ef-8278-4f8c-b284-f82586f5f3ed tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:34.020920 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-715de5df-af12-4db0-966b-0179e0a6f8d3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:34.021847 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-715de5df-af12-4db0-966b-0179e0a6f8d3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:34.036874 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-715de5df-af12-4db0-966b-0179e0a6f8d3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:34.037322 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-715de5df-af12-4db0-966b-0179e0a6f8d3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:34.038192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-715de5df-af12-4db0-966b-0179e0a6f8d3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:34.038660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-715de5df-af12-4db0-966b-0179e0a6f8d3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:34.134958 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d75325ef-8278-4f8c-b284-f82586f5f3ed tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:34.152693 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-715de5df-af12-4db0-966b-0179e0a6f8d3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28834 microversion: 2.20 time: 0.135871 Dec 18 03:13:34.154169 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 67/153] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:34 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28834 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:13:34.176178 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d75325ef-8278-4f8c-b284-f82586f5f3ed tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.286640 Dec 18 03:13:34.182851 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 87/154] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:33 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:34.495481 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fc81410f-d653-469b-9f18-70f0e2445aac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:34.496271 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-fc81410f-d653-469b-9f18-70f0e2445aac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:34.510209 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc81410f-d653-469b-9f18-70f0e2445aac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:34.511826 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc81410f-d653-469b-9f18-70f0e2445aac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:34.513793 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc81410f-d653-469b-9f18-70f0e2445aac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:34.514263 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc81410f-d653-469b-9f18-70f0e2445aac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:34.817082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-fc81410f-d653-469b-9f18-70f0e2445aac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:34.830334 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-fc81410f-d653-469b-9f18-70f0e2445aac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1322 microversion: 2.1 time: 0.342588 Dec 18 03:13:34.841458 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 68/155] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:34 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:35.091689 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-b69c5a8f-b3d8-4c3e-afdb-a18ff60509e9 req-b9a1acfb-1d3b-4b0d-81c8-b995f7e1910b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8102ec12-6bb2-46cd-b456-ca768186be97", "tag": "3ba51193-82e6-4c57-b600-96ad802c4b8f"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:35.093138 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:35.093138 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:13:35.115379 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-b69c5a8f-b3d8-4c3e-afdb-a18ff60509e9 req-b9a1acfb-1d3b-4b0d-81c8-b995f7e1910b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:35.116379 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-b69c5a8f-b3d8-4c3e-afdb-a18ff60509e9 req-b9a1acfb-1d3b-4b0d-81c8-b995f7e1910b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:35.131336 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-b69c5a8f-b3d8-4c3e-afdb-a18ff60509e9 req-b9a1acfb-1d3b-4b0d-81c8-b995f7e1910b service nova] Creating event network-changed:3ba51193-82e6-4c57-b600-96ad802c4b8f for instance 8102ec12-6bb2-46cd-b456-ca768186be97 on hv-cinder-81803 Dec 18 03:13:35.136905 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-b69c5a8f-b3d8-4c3e-afdb-a18ff60509e9 req-b9a1acfb-1d3b-4b0d-81c8-b995f7e1910b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048941 Dec 18 03:13:35.137497 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 88/156] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:13:35.165952 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4c9fda4a-87c7-448c-ad56-8e4582dd08f4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:35.166876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4c9fda4a-87c7-448c-ad56-8e4582dd08f4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:35.174038 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4c9fda4a-87c7-448c-ad56-8e4582dd08f4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:35.174756 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4c9fda4a-87c7-448c-ad56-8e4582dd08f4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:35.175786 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4c9fda4a-87c7-448c-ad56-8e4582dd08f4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:35.176352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4c9fda4a-87c7-448c-ad56-8e4582dd08f4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:35.201126 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d8812f3e-62e8-4eda-80d5-cd2cb288bb1a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:35.202144 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d8812f3e-62e8-4eda-80d5-cd2cb288bb1a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:35.212942 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8812f3e-62e8-4eda-80d5-cd2cb288bb1a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:35.215223 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8812f3e-62e8-4eda-80d5-cd2cb288bb1a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:35.216149 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8812f3e-62e8-4eda-80d5-cd2cb288bb1a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:35.216575 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8812f3e-62e8-4eda-80d5-cd2cb288bb1a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:35.287739 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4c9fda4a-87c7-448c-ad56-8e4582dd08f4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28834 microversion: 2.20 time: 0.126457 Dec 18 03:13:35.288636 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 69/157] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:35 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28834 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:13:35.432702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-f0cf8a9a-f1c5-443c-8078-a2ce186455fe req-279dfd45-0ace-4b8a-a2b5-4e7999ad4a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a", "tag": "86a51a4c-eba1-4460-a8c6-1adb483f5473"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:35.435087 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:35.435087 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:13:35.448681 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-f0cf8a9a-f1c5-443c-8078-a2ce186455fe req-279dfd45-0ace-4b8a-a2b5-4e7999ad4a03 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:35.449345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-f0cf8a9a-f1c5-443c-8078-a2ce186455fe req-279dfd45-0ace-4b8a-a2b5-4e7999ad4a03 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:35.464386 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-f0cf8a9a-f1c5-443c-8078-a2ce186455fe req-279dfd45-0ace-4b8a-a2b5-4e7999ad4a03 service nova] Creating event network-changed:86a51a4c-eba1-4460-a8c6-1adb483f5473 for instance d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a on hv-cinder-81803 Dec 18 03:13:35.473262 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-f0cf8a9a-f1c5-443c-8078-a2ce186455fe req-279dfd45-0ace-4b8a-a2b5-4e7999ad4a03 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049903 Dec 18 03:13:35.474468 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 70/158] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:13:35.492903 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d8812f3e-62e8-4eda-80d5-cd2cb288bb1a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:35.502243 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d8812f3e-62e8-4eda-80d5-cd2cb288bb1a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.304541 Dec 18 03:13:35.505572 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 89/159] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:35 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:35.849288 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-aaff8e73-e61d-45a0-ab6c-f01b3a0141b6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:35.850149 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-aaff8e73-e61d-45a0-ab6c-f01b3a0141b6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:35.857055 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aaff8e73-e61d-45a0-ab6c-f01b3a0141b6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:35.857808 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aaff8e73-e61d-45a0-ab6c-f01b3a0141b6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:35.858852 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aaff8e73-e61d-45a0-ab6c-f01b3a0141b6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:35.859469 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aaff8e73-e61d-45a0-ab6c-f01b3a0141b6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:36.069506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-9843f08f-e673-4f66-8f36-61c223043caf req-dffd4d69-7406-4f0a-b92e-849b9f04d22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c1697d-abd6-44f6-b11e-e6407b595fa9", "name": "network-vif-plugged", "status": "completed", "tag": "01a67308-4fa3-4c17-9106-2b102610d2fe"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:36.076164 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:36.076164 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:13:36.100393 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-9843f08f-e673-4f66-8f36-61c223043caf req-dffd4d69-7406-4f0a-b92e-849b9f04d22b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:36.101598 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-9843f08f-e673-4f66-8f36-61c223043caf req-dffd4d69-7406-4f0a-b92e-849b9f04d22b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:36.125334 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-9843f08f-e673-4f66-8f36-61c223043caf req-dffd4d69-7406-4f0a-b92e-849b9f04d22b service nova] Creating event network-vif-plugged:01a67308-4fa3-4c17-9106-2b102610d2fe for instance 49c1697d-abd6-44f6-b11e-e6407b595fa9 on hv-cinder-81803 Dec 18 03:13:36.141360 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-9843f08f-e673-4f66-8f36-61c223043caf req-dffd4d69-7406-4f0a-b92e-849b9f04d22b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081131 Dec 18 03:13:36.142570 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 90/160] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:13:36.257193 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-aaff8e73-e61d-45a0-ab6c-f01b3a0141b6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:36.274438 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-aaff8e73-e61d-45a0-ab6c-f01b3a0141b6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1322 microversion: 2.1 time: 0.422342 Dec 18 03:13:36.281657 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 71/161] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:35 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:36.301383 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2408d33a-dcca-4b65-aeec-04ac821b271f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:36.304492 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2408d33a-dcca-4b65-aeec-04ac821b271f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:36.322259 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2408d33a-dcca-4b65-aeec-04ac821b271f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:36.322705 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2408d33a-dcca-4b65-aeec-04ac821b271f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:36.341977 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2408d33a-dcca-4b65-aeec-04ac821b271f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:36.342469 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2408d33a-dcca-4b65-aeec-04ac821b271f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:36.520576 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8d1aa9ef-f647-4059-8c0d-4752afa3e6d5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:36.521192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8d1aa9ef-f647-4059-8c0d-4752afa3e6d5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:36.528530 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9ef-f647-4059-8c0d-4752afa3e6d5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:36.528987 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9ef-f647-4059-8c0d-4752afa3e6d5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:36.529811 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9ef-f647-4059-8c0d-4752afa3e6d5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:36.530243 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9ef-f647-4059-8c0d-4752afa3e6d5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:36.642418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2408d33a-dcca-4b65-aeec-04ac821b271f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 28834 microversion: 2.20 time: 0.344984 Dec 18 03:13:36.643363 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 91/162] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:36 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 28834 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:36.863225 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8d1aa9ef-f647-4059-8c0d-4752afa3e6d5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:36.871903 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8d1aa9ef-f647-4059-8c0d-4752afa3e6d5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.355412 Dec 18 03:13:36.875457 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 72/163] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:36 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:37.289861 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9eb48781-344f-4462-81fd-adde4dbdef1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:37.290722 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9eb48781-344f-4462-81fd-adde4dbdef1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:37.301908 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9eb48781-344f-4462-81fd-adde4dbdef1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:37.303079 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9eb48781-344f-4462-81fd-adde4dbdef1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:37.305359 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9eb48781-344f-4462-81fd-adde4dbdef1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:37.308328 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9eb48781-344f-4462-81fd-adde4dbdef1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:37.529372 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9eb48781-344f-4462-81fd-adde4dbdef1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:37.539566 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9eb48781-344f-4462-81fd-adde4dbdef1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1322 microversion: 2.1 time: 0.253966 Dec 18 03:13:37.542336 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 92/164] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:37 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:37.669404 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-733dcd99-e8ef-4433-b8d5-6821da7143fd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:37.671571 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-733dcd99-e8ef-4433-b8d5-6821da7143fd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:37.686081 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-733dcd99-e8ef-4433-b8d5-6821da7143fd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:37.687172 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-733dcd99-e8ef-4433-b8d5-6821da7143fd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:37.688374 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-733dcd99-e8ef-4433-b8d5-6821da7143fd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:37.688959 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-733dcd99-e8ef-4433-b8d5-6821da7143fd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:37.849837 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-733dcd99-e8ef-4433-b8d5-6821da7143fd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 29200 microversion: 2.20 time: 0.184752 Dec 18 03:13:37.850588 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 73/165] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:37 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 29200 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:37.892289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-317ff454-eee0-4103-b7f5-51f65d305293 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:37.892960 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-317ff454-eee0-4103-b7f5-51f65d305293 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:37.901265 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-317ff454-eee0-4103-b7f5-51f65d305293 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:37.902291 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-317ff454-eee0-4103-b7f5-51f65d305293 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:37.903277 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-317ff454-eee0-4103-b7f5-51f65d305293 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:37.903899 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-317ff454-eee0-4103-b7f5-51f65d305293 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:38.094572 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-317ff454-eee0-4103-b7f5-51f65d305293 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:38.102807 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-317ff454-eee0-4103-b7f5-51f65d305293 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1317 microversion: 2.1 time: 0.214122 Dec 18 03:13:38.103368 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 93/166] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:37 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:38.561822 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c3a76e52-0935-41ae-9ab0-8eb779098186 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:38.561822 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c3a76e52-0935-41ae-9ab0-8eb779098186 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:38.568869 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c3a76e52-0935-41ae-9ab0-8eb779098186 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:38.569318 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c3a76e52-0935-41ae-9ab0-8eb779098186 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:38.572979 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c3a76e52-0935-41ae-9ab0-8eb779098186 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:38.573662 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c3a76e52-0935-41ae-9ab0-8eb779098186 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:38.753554 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c3a76e52-0935-41ae-9ab0-8eb779098186 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:38.762304 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c3a76e52-0935-41ae-9ab0-8eb779098186 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1322 microversion: 2.1 time: 0.207690 Dec 18 03:13:38.762872 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 74/167] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:38 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:38.861499 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c9c729ee-cf30-4099-8a7b-3fd2039e4b5c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:38.862445 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c9c729ee-cf30-4099-8a7b-3fd2039e4b5c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:38.868976 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9c729ee-cf30-4099-8a7b-3fd2039e4b5c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:38.869426 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9c729ee-cf30-4099-8a7b-3fd2039e4b5c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:38.870247 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9c729ee-cf30-4099-8a7b-3fd2039e4b5c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:38.870684 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9c729ee-cf30-4099-8a7b-3fd2039e4b5c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:38.979460 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c9c729ee-cf30-4099-8a7b-3fd2039e4b5c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 30162 microversion: 2.20 time: 0.121204 Dec 18 03:13:38.980570 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 94/168] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:38 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 30162 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:39.121213 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2ee3a6ee-2e33-44d6-9f4c-0183fea3c3b1 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:39.121926 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2ee3a6ee-2e33-44d6-9f4c-0183fea3c3b1 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:39.129863 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2ee3a6ee-2e33-44d6-9f4c-0183fea3c3b1 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.130712 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2ee3a6ee-2e33-44d6-9f4c-0183fea3c3b1 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.131750 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2ee3a6ee-2e33-44d6-9f4c-0183fea3c3b1 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.132395 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2ee3a6ee-2e33-44d6-9f4c-0183fea3c3b1 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.282277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2ee3a6ee-2e33-44d6-9f4c-0183fea3c3b1 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:39.289809 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2ee3a6ee-2e33-44d6-9f4c-0183fea3c3b1 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1508 microversion: 2.1 time: 0.174121 Dec 18 03:13:39.291006 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 75/169] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:39 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:39.307934 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5da2cb64-9be1-448a-b703-6700721af361 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "910c954c-ddcb-434c-ad26-8a3147930530"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:39.309239 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5da2cb64-9be1-448a-b703-6700721af361 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:39.315813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5da2cb64-9be1-448a-b703-6700721af361 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.316262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5da2cb64-9be1-448a-b703-6700721af361 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.317021 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5da2cb64-9be1-448a-b703-6700721af361 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.317774 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5da2cb64-9be1-448a-b703-6700721af361 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.419416 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-5da2cb64-9be1-448a-b703-6700721af361 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] HTTP exception thrown: Invalid volume: volume 910c954c-ddcb-434c-ad26-8a3147930530 is already attached to instances: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2 Dec 18 03:13:39.420175 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5da2cb64-9be1-448a-b703-6700721af361 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Returning 400 to user: Invalid volume: volume 910c954c-ddcb-434c-ad26-8a3147930530 is already attached to instances: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2 {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:13:39.421208 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5da2cb64-9be1-448a-b703-6700721af361 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "POST /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118557 Dec 18 03:13:39.422015 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 95/170] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:13:39 2021] POST /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:13:39.482333 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a803c1eb-378b-4904-871f-d4ca5e76e44b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:39.482743 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a803c1eb-378b-4904-871f-d4ca5e76e44b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:39.489062 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a803c1eb-378b-4904-871f-d4ca5e76e44b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.489505 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a803c1eb-378b-4904-871f-d4ca5e76e44b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.490550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a803c1eb-378b-4904-871f-d4ca5e76e44b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.490962 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a803c1eb-378b-4904-871f-d4ca5e76e44b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.624885 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-a803c1eb-378b-4904-871f-d4ca5e76e44b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lazy-loading 'services' on Instance uuid 9f325d5a-7adf-4af8-8559-7f60b99ed6e2 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:13:39.777055 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a803c1eb-378b-4904-871f-d4ca5e76e44b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2/os-volume_attachments/910c954c-ddcb-434c-ad26-8a3147930530" status: 202 len: 0 microversion: 2.1 time: 0.298543 Dec 18 03:13:39.778038 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 76/171] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:13:39 2021] DELETE /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2/os-volume_attachments/910c954c-ddcb-434c-ad26-8a3147930530 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:39.782463 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7aafd109-029b-486a-9389-fe0e34602630 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:39.783590 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7aafd109-029b-486a-9389-fe0e34602630 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:39.789165 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e879f791-36a6-444d-b5e1-08fd4ec3b01b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:39.790673 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e879f791-36a6-444d-b5e1-08fd4ec3b01b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:39.813979 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e879f791-36a6-444d-b5e1-08fd4ec3b01b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.817436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e879f791-36a6-444d-b5e1-08fd4ec3b01b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.822075 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e879f791-36a6-444d-b5e1-08fd4ec3b01b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.822768 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7aafd109-029b-486a-9389-fe0e34602630 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.823130 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e879f791-36a6-444d-b5e1-08fd4ec3b01b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.824833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7aafd109-029b-486a-9389-fe0e34602630 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.845064 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7aafd109-029b-486a-9389-fe0e34602630 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:39.847802 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7aafd109-029b-486a-9389-fe0e34602630 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:39.928233 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e879f791-36a6-444d-b5e1-08fd4ec3b01b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145851 Dec 18 03:13:39.930898 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 77/172] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:13:39 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:13:39.936562 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1883943553", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:40.010749 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] validate_networks() for None {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:13:40.238013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7aafd109-029b-486a-9389-fe0e34602630 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:40.248709 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7aafd109-029b-486a-9389-fe0e34602630 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1322 microversion: 2.1 time: 0.469573 Dec 18 03:13:40.259783 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 96/173] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:39 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:40.259783 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-36b87435-8e95-47d0-a968-0bc3938733a4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:40.262393 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-36b87435-8e95-47d0-a968-0bc3938733a4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:40.268852 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-36b87435-8e95-47d0-a968-0bc3938733a4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:40.269385 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-36b87435-8e95-47d0-a968-0bc3938733a4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:40.270418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-36b87435-8e95-47d0-a968-0bc3938733a4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:40.270920 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-36b87435-8e95-47d0-a968-0bc3938733a4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:40.437847 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-36b87435-8e95-47d0-a968-0bc3938733a4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 32241 microversion: 2.20 time: 0.184048 Dec 18 03:13:40.439226 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 97/174] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:40 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 32241 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:40.506086 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:13:40.506501 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:13:40.507144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:13:40.507907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:13:40.508471 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:13:40.525655 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:40.526362 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:40.527413 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:40.530751 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:40.561240 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Getting quotas for project 83a0c96a8b9042b985620098618d5fb6. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:13:40.566182 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Getting quotas for user 17cafa92761a4f568af959a44d6ba1f7 and project 83a0c96a8b9042b985620098618d5fb6. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:13:40.579941 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:13:40.582941 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:13:40.690700 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ce12c931-5b49-4eb1-8f13-16184a93b785 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758441 Dec 18 03:13:40.691345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 78/175] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:13:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:13:40.701974 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5ebf6c7d-c227-4d71-b7a1-40699e460b36 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:40.702826 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5ebf6c7d-c227-4d71-b7a1-40699e460b36 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:40.830304 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5ebf6c7d-c227-4d71-b7a1-40699e460b36 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:40.839695 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5ebf6c7d-c227-4d71-b7a1-40699e460b36 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1215 microversion: 2.1 time: 0.141842 Dec 18 03:13:40.841703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 98/176] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:40 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:40.942735 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b15d0389-0aaf-4e11-a7de-de7bd32b28a0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:40.944066 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b15d0389-0aaf-4e11-a7de-de7bd32b28a0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:40.983538 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b15d0389-0aaf-4e11-a7de-de7bd32b28a0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:40.984047 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b15d0389-0aaf-4e11-a7de-de7bd32b28a0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:40.985015 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b15d0389-0aaf-4e11-a7de-de7bd32b28a0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:40.988377 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b15d0389-0aaf-4e11-a7de-de7bd32b28a0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:41.224325 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b15d0389-0aaf-4e11-a7de-de7bd32b28a0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.286220 Dec 18 03:13:41.225242 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 79/177] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:13:40 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2/os-volume_attachments => generated 25 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:13:41.267213 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7e4f9243-66d3-4db3-9744-50c06ec40c1e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:41.267818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7e4f9243-66d3-4db3-9744-50c06ec40c1e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:41.279344 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7e4f9243-66d3-4db3-9744-50c06ec40c1e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:41.279790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7e4f9243-66d3-4db3-9744-50c06ec40c1e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:41.280588 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7e4f9243-66d3-4db3-9744-50c06ec40c1e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:41.281021 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7e4f9243-66d3-4db3-9744-50c06ec40c1e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:41.462579 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7bd0f6c5-912f-4cf3-be15-e40dabb92254 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:41.466630 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7bd0f6c5-912f-4cf3-be15-e40dabb92254 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:41.477419 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6c5-912f-4cf3-be15-e40dabb92254 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:41.477899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6c5-912f-4cf3-be15-e40dabb92254 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:41.481224 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6c5-912f-4cf3-be15-e40dabb92254 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:41.481692 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6c5-912f-4cf3-be15-e40dabb92254 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:41.584090 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7e4f9243-66d3-4db3-9744-50c06ec40c1e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:41.595429 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7e4f9243-66d3-4db3-9744-50c06ec40c1e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1322 microversion: 2.1 time: 0.331450 Dec 18 03:13:41.596696 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 99/178] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:41 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:41.670748 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7bd0f6c5-912f-4cf3-be15-e40dabb92254 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 33556 microversion: 2.20 time: 0.224428 Dec 18 03:13:41.671939 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 80/179] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:41 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 33556 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:13:41.856468 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f0623165-4070-4ef8-9acd-c1b5a701f25e tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:41.857606 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f0623165-4070-4ef8-9acd-c1b5a701f25e tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:41.867881 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f0623165-4070-4ef8-9acd-c1b5a701f25e tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:41.868418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f0623165-4070-4ef8-9acd-c1b5a701f25e tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:41.878735 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f0623165-4070-4ef8-9acd-c1b5a701f25e tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:41.880572 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f0623165-4070-4ef8-9acd-c1b5a701f25e tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:42.011750 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f0623165-4070-4ef8-9acd-c1b5a701f25e tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:42.027200 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f0623165-4070-4ef8-9acd-c1b5a701f25e tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1267 microversion: 2.1 time: 0.172650 Dec 18 03:13:42.027930 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 100/180] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:41 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:42.178785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-754840110", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "networks": [{"uuid": "1d8dfc79-d3fb-4837-9660-6625a84f5064"}]}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:42.293130 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] validate_networks() for [('1d8dfc79-d3fb-4837-9660-6625a84f5064', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:13:42.613244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-02c357c2-8bc9-4e21-8b45-46b457b0e477 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:42.615033 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-02c357c2-8bc9-4e21-8b45-46b457b0e477 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:42.627186 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-02c357c2-8bc9-4e21-8b45-46b457b0e477 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:42.628408 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-02c357c2-8bc9-4e21-8b45-46b457b0e477 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:42.632379 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-02c357c2-8bc9-4e21-8b45-46b457b0e477 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:42.634708 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-02c357c2-8bc9-4e21-8b45-46b457b0e477 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:42.959891 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:13:42.960359 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:13:42.962034 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:13:42.962505 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:13:42.962912 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:13:42.973441 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:42.974312 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:42.975190 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:42.975634 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:42.996262 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Getting quotas for project e04a810a1bed41eb90634777ccbde0f4. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:13:43.001598 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Getting quotas for user 208a33c69dc44f399bac2a34bc018ef1 and project e04a810a1bed41eb90634777ccbde0f4. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:13:43.013410 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:13:43.015896 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:13:43.069850 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e0fa6500-315c-4494-90a0-6d228e4a2865 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895191 Dec 18 03:13:43.076138 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 81/181] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:13:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 03:13:43.080792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-72907a5a-ef79-45e5-8007-1bc5356b6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:43.082476 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-72907a5a-ef79-45e5-8007-1bc5356b6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:43.094159 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-72907a5a-ef79-45e5-8007-1bc5356b6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:43.095125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-72907a5a-ef79-45e5-8007-1bc5356b6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:43.096341 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-72907a5a-ef79-45e5-8007-1bc5356b6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:43.097058 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-72907a5a-ef79-45e5-8007-1bc5356b6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:43.142040 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-02c357c2-8bc9-4e21-8b45-46b457b0e477 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:43.163516 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-02c357c2-8bc9-4e21-8b45-46b457b0e477 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1322 microversion: 2.1 time: 0.551334 Dec 18 03:13:43.179938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 101/182] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:42 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:43.202215 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1d3a4c6e-94d8-4f90-af10-c588357581bb tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:43.202954 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1d3a4c6e-94d8-4f90-af10-c588357581bb tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:43.228860 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1d3a4c6e-94d8-4f90-af10-c588357581bb tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:43.230394 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1d3a4c6e-94d8-4f90-af10-c588357581bb tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:43.236849 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1d3a4c6e-94d8-4f90-af10-c588357581bb tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:43.237366 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1d3a4c6e-94d8-4f90-af10-c588357581bb tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:43.318646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-72907a5a-ef79-45e5-8007-1bc5356b6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 34165 microversion: 2.20 time: 0.246784 Dec 18 03:13:43.319296 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 82/183] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:43 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 34165 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:43.325082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7d47e387-0fd5-4889-9664-25079126f8a2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:43.329931 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7d47e387-0fd5-4889-9664-25079126f8a2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:43.387822 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1d3a4c6e-94d8-4f90-af10-c588357581bb tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:43.402375 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1d3a4c6e-94d8-4f90-af10-c588357581bb tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1273 microversion: 2.1 time: 0.221078 Dec 18 03:13:43.403079 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 102/184] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:43 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:43.673169 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7d47e387-0fd5-4889-9664-25079126f8a2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:43.684800 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7d47e387-0fd5-4889-9664-25079126f8a2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1217 microversion: 2.1 time: 0.363594 Dec 18 03:13:43.685676 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 83/185] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:43 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1217 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:43.870387 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-700955606", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "networks": [{"uuid": "56ac0911-7660-4a3b-957e-b00bd8c0a253"}]}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:43.956481 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] validate_networks() for [('56ac0911-7660-4a3b-957e-b00bd8c0a253', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:13:44.105329 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-5d33acb4-2aa7-4d5e-abfa-420605ac3b8d req-1508196f-710a-4aca-a803-2464ba4b43c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8102ec12-6bb2-46cd-b456-ca768186be97", "name": "network-vif-plugged", "status": "completed", "tag": "3ba51193-82e6-4c57-b600-96ad802c4b8f"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:44.107137 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:44.107137 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:13:44.135203 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-5d33acb4-2aa7-4d5e-abfa-420605ac3b8d req-1508196f-710a-4aca-a803-2464ba4b43c9 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:44.135707 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-5d33acb4-2aa7-4d5e-abfa-420605ac3b8d req-1508196f-710a-4aca-a803-2464ba4b43c9 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:44.181585 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-5d33acb4-2aa7-4d5e-abfa-420605ac3b8d req-1508196f-710a-4aca-a803-2464ba4b43c9 service nova] Creating event network-vif-plugged:3ba51193-82e6-4c57-b600-96ad802c4b8f for instance 8102ec12-6bb2-46cd-b456-ca768186be97 on hv-cinder-81803 Dec 18 03:13:44.204976 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-5d33acb4-2aa7-4d5e-abfa-420605ac3b8d req-1508196f-710a-4aca-a803-2464ba4b43c9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094959 Dec 18 03:13:44.206165 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 84/186] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:13:44.212217 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-dac62c5b-a0cd-4ab0-b0dd-6b7f6bd4c395 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:44.213119 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-dac62c5b-a0cd-4ab0-b0dd-6b7f6bd4c395 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:44.220656 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dac62c5b-a0cd-4ab0-b0dd-6b7f6bd4c395 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:44.221346 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dac62c5b-a0cd-4ab0-b0dd-6b7f6bd4c395 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:44.222474 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dac62c5b-a0cd-4ab0-b0dd-6b7f6bd4c395 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:44.223365 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dac62c5b-a0cd-4ab0-b0dd-6b7f6bd4c395 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:44.738043 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-dac62c5b-a0cd-4ab0-b0dd-6b7f6bd4c395 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:44.747010 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-dac62c5b-a0cd-4ab0-b0dd-6b7f6bd4c395 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1322 microversion: 2.1 time: 0.539356 Dec 18 03:13:44.751824 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 85/187] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:44 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:44.758702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-db4ed969-e6c3-4f5b-9d17-accd979682ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:44.764527 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-db4ed969-e6c3-4f5b-9d17-accd979682ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:44.780606 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db4ed969-e6c3-4f5b-9d17-accd979682ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:44.781766 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db4ed969-e6c3-4f5b-9d17-accd979682ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:44.783163 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db4ed969-e6c3-4f5b-9d17-accd979682ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:44.784832 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db4ed969-e6c3-4f5b-9d17-accd979682ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:44.835662 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:13:44.836201 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:13:44.836736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:13:44.837120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:13:44.837725 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:13:44.872293 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:44.873085 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:44.873555 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:44.881655 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:44.939205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Getting quotas for project 720269d188094f32978b00a4858a2da0. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:13:44.940106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-db4ed969-e6c3-4f5b-9d17-accd979682ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 35318 microversion: 2.20 time: 0.186735 Dec 18 03:13:44.944686 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 86/188] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:44 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 35318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:44.951208 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Getting quotas for user 5bb75fbada72413da5ed9a1b24f1ed6d and project 720269d188094f32978b00a4858a2da0. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:13:44.955012 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f5c9faf2-9418-43f2-a3ec-f1943ecd6e19 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:44.957390 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f5c9faf2-9418-43f2-a3ec-f1943ecd6e19 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:44.970237 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f5c9faf2-9418-43f2-a3ec-f1943ecd6e19 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:44.970673 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f5c9faf2-9418-43f2-a3ec-f1943ecd6e19 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:44.971849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f5c9faf2-9418-43f2-a3ec-f1943ecd6e19 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:44.972436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f5c9faf2-9418-43f2-a3ec-f1943ecd6e19 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:44.992946 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:13:45.001357 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:13:45.124899 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-922cc0a1-9ca2-47d7-a4d1-6eaad9ccc403 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.259621 Dec 18 03:13:45.128612 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 103/189] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:13:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 03:13:45.144659 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b7479f07-037d-43b3-b094-be35e578875a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:45.145317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b7479f07-037d-43b3-b094-be35e578875a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:45.156507 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7479f07-037d-43b3-b094-be35e578875a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:45.157153 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7479f07-037d-43b3-b094-be35e578875a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:45.158111 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7479f07-037d-43b3-b094-be35e578875a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:45.158815 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7479f07-037d-43b3-b094-be35e578875a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:45.269186 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f5c9faf2-9418-43f2-a3ec-f1943ecd6e19 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:45.284035 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f5c9faf2-9418-43f2-a3ec-f1943ecd6e19 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1315 microversion: 2.1 time: 0.334048 Dec 18 03:13:45.287586 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 87/190] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:44 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:45.299916 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0b3cc609-9038-4fae-accb-9a01c118326d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:45.301457 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b7479f07-037d-43b3-b094-be35e578875a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:45.302690 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0b3cc609-9038-4fae-accb-9a01c118326d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:45.315181 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b7479f07-037d-43b3-b094-be35e578875a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1287 microversion: 2.1 time: 0.180980 Dec 18 03:13:45.315706 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 104/191] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:45 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:45.511965 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0b3cc609-9038-4fae-accb-9a01c118326d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:45.538113 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0b3cc609-9038-4fae-accb-9a01c118326d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1213 microversion: 2.1 time: 0.248824 Dec 18 03:13:45.538794 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 88/192] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:45 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1213 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:45.767412 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e78e7f50-2f80-4b53-9f9c-daa97e775998 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:45.768305 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e78e7f50-2f80-4b53-9f9c-daa97e775998 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:45.776774 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e78e7f50-2f80-4b53-9f9c-daa97e775998 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:45.777581 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e78e7f50-2f80-4b53-9f9c-daa97e775998 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:45.778613 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e78e7f50-2f80-4b53-9f9c-daa97e775998 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:45.779183 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e78e7f50-2f80-4b53-9f9c-daa97e775998 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:45.952673 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b114896a-2b97-43c7-ad92-f488f6418eb1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:45.954495 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b114896a-2b97-43c7-ad92-f488f6418eb1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:45.970602 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b114896a-2b97-43c7-ad92-f488f6418eb1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:45.971247 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b114896a-2b97-43c7-ad92-f488f6418eb1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:45.972192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b114896a-2b97-43c7-ad92-f488f6418eb1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:45.972774 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b114896a-2b97-43c7-ad92-f488f6418eb1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:46.047487 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e78e7f50-2f80-4b53-9f9c-daa97e775998 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:46.062782 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e78e7f50-2f80-4b53-9f9c-daa97e775998 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1322 microversion: 2.1 time: 0.298942 Dec 18 03:13:46.063371 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 105/193] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:45 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:46.072668 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-68e5605f-8ff1-4e70-bd62-0a95d54cb394 req-084d8bae-24df-42e9-bc40-5aca5fe683ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7171a8a-454c-4893-9d06-482322c37d16", "tag": "89c9d737-9fbe-413b-94fc-e8c0330894d5"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:46.074369 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:46.074369 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:13:46.092573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-68e5605f-8ff1-4e70-bd62-0a95d54cb394 req-084d8bae-24df-42e9-bc40-5aca5fe683ec service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:46.094109 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-68e5605f-8ff1-4e70-bd62-0a95d54cb394 req-084d8bae-24df-42e9-bc40-5aca5fe683ec service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:46.122638 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-68e5605f-8ff1-4e70-bd62-0a95d54cb394 req-084d8bae-24df-42e9-bc40-5aca5fe683ec service nova] Creating event network-changed:89c9d737-9fbe-413b-94fc-e8c0330894d5 for instance d7171a8a-454c-4893-9d06-482322c37d16 on hv-cinder-81803 Dec 18 03:13:46.136506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-68e5605f-8ff1-4e70-bd62-0a95d54cb394 req-084d8bae-24df-42e9-bc40-5aca5fe683ec service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067052 Dec 18 03:13:46.137802 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 106/194] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:13:46.155546 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b114896a-2b97-43c7-ad92-f488f6418eb1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 35984 microversion: 2.20 time: 0.206574 Dec 18 03:13:46.156686 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 89/195] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:45 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 35984 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:13:46.294174 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-a83b14f8-fa7e-4f59-8bab-5e23f5b68b8f req-86416dd0-80f8-44b8-99c6-6059f4ee2112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a", "name": "network-vif-plugged", "status": "completed", "tag": "86a51a4c-eba1-4460-a8c6-1adb483f5473"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:46.296120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:46.296120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:13:46.304414 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bbf0e3f3-6c62-471f-8516-ba722c96583f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:46.305502 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bbf0e3f3-6c62-471f-8516-ba722c96583f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:46.305805 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-a83b14f8-fa7e-4f59-8bab-5e23f5b68b8f req-86416dd0-80f8-44b8-99c6-6059f4ee2112 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:46.306735 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-a83b14f8-fa7e-4f59-8bab-5e23f5b68b8f req-86416dd0-80f8-44b8-99c6-6059f4ee2112 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:46.314645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbf0e3f3-6c62-471f-8516-ba722c96583f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:46.315260 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbf0e3f3-6c62-471f-8516-ba722c96583f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:46.316274 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbf0e3f3-6c62-471f-8516-ba722c96583f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:46.316709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbf0e3f3-6c62-471f-8516-ba722c96583f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:46.323104 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-a83b14f8-fa7e-4f59-8bab-5e23f5b68b8f req-86416dd0-80f8-44b8-99c6-6059f4ee2112 service nova] Creating event network-vif-plugged:86a51a4c-eba1-4460-a8c6-1adb483f5473 for instance d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a on hv-cinder-81803 Dec 18 03:13:46.329301 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-a83b14f8-fa7e-4f59-8bab-5e23f5b68b8f req-86416dd0-80f8-44b8-99c6-6059f4ee2112 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040024 Dec 18 03:13:46.330255 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 107/196] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:13:46.338967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-898aa8f4-6cc6-4eb0-b833-a532a5f1d440 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:46.339819 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-898aa8f4-6cc6-4eb0-b833-a532a5f1d440 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:46.346463 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-898aa8f4-6cc6-4eb0-b833-a532a5f1d440 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:46.347105 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-898aa8f4-6cc6-4eb0-b833-a532a5f1d440 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:46.348384 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-898aa8f4-6cc6-4eb0-b833-a532a5f1d440 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:46.349672 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-898aa8f4-6cc6-4eb0-b833-a532a5f1d440 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:46.681457 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-898aa8f4-6cc6-4eb0-b833-a532a5f1d440 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:46.690295 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-898aa8f4-6cc6-4eb0-b833-a532a5f1d440 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.358227 Dec 18 03:13:46.692570 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 108/197] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:46 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:46.707270 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-23c576a0-c8ee-4006-8667-4d416f8ed06a tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:46.709501 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-23c576a0-c8ee-4006-8667-4d416f8ed06a tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:46.722041 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23c576a0-c8ee-4006-8667-4d416f8ed06a tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:46.727524 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23c576a0-c8ee-4006-8667-4d416f8ed06a tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:46.730770 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23c576a0-c8ee-4006-8667-4d416f8ed06a tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:46.731397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23c576a0-c8ee-4006-8667-4d416f8ed06a tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:46.810915 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bbf0e3f3-6c62-471f-8516-ba722c96583f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:46.819785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bbf0e3f3-6c62-471f-8516-ba722c96583f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1315 microversion: 2.1 time: 0.519192 Dec 18 03:13:46.829599 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 90/198] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:46 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:46.831378 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-23c576a0-c8ee-4006-8667-4d416f8ed06a tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:46.844252 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-23c576a0-c8ee-4006-8667-4d416f8ed06a tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1265 microversion: 2.1 time: 0.147578 Dec 18 03:13:46.846977 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 109/199] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:46 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:47.079713 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3ec4931f-3d16-407f-8314-e72e25f10d1d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:47.080968 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3ec4931f-3d16-407f-8314-e72e25f10d1d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:47.087868 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ec4931f-3d16-407f-8314-e72e25f10d1d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.088316 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ec4931f-3d16-407f-8314-e72e25f10d1d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.089104 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ec4931f-3d16-407f-8314-e72e25f10d1d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.089554 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ec4931f-3d16-407f-8314-e72e25f10d1d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.168126 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1c78efd6-2a95-4531-8048-0b257f153f51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:47.169039 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1c78efd6-2a95-4531-8048-0b257f153f51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:47.177176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c78efd6-2a95-4531-8048-0b257f153f51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.177645 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c78efd6-2a95-4531-8048-0b257f153f51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.178439 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c78efd6-2a95-4531-8048-0b257f153f51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.178875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c78efd6-2a95-4531-8048-0b257f153f51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.296564 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3ec4931f-3d16-407f-8314-e72e25f10d1d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:47.306364 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3ec4931f-3d16-407f-8314-e72e25f10d1d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1515 microversion: 2.1 time: 0.230261 Dec 18 03:13:47.306945 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 91/200] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:47 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1515 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:47.322994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c8cef4ff-2e57-4c7f-95e0-607d018ce289 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:47.324072 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c8cef4ff-2e57-4c7f-95e0-607d018ce289 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:47.333613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8cef4ff-2e57-4c7f-95e0-607d018ce289 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.333903 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8cef4ff-2e57-4c7f-95e0-607d018ce289 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.334903 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8cef4ff-2e57-4c7f-95e0-607d018ce289 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.336465 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8cef4ff-2e57-4c7f-95e0-607d018ce289 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.365542 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-c8cef4ff-2e57-4c7f-95e0-607d018ce289 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lazy-loading 'flavor' on Instance uuid 8102ec12-6bb2-46cd-b456-ca768186be97 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:13:47.513587 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c8cef4ff-2e57-4c7f-95e0-607d018ce289 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "POST /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97/action" status: 200 len: 32 microversion: 2.1 time: 0.194956 Dec 18 03:13:47.514576 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 92/201] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:13:47 2021] POST /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 03:13:47.523743 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-114dcfc3-ed98-420b-801a-147ee6bdc843 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:47.524638 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-114dcfc3-ed98-420b-801a-147ee6bdc843 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:47.531393 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-114dcfc3-ed98-420b-801a-147ee6bdc843 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.531844 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-114dcfc3-ed98-420b-801a-147ee6bdc843 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.532803 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-114dcfc3-ed98-420b-801a-147ee6bdc843 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.533389 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-114dcfc3-ed98-420b-801a-147ee6bdc843 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.620938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1c78efd6-2a95-4531-8048-0b257f153f51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 36773 microversion: 2.20 time: 0.456846 Dec 18 03:13:47.626016 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 110/202] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:47 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 36773 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:13:47.711999 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-11b7735f-17a2-42b6-a6cd-50e0ddd3dc87 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:47.712717 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-11b7735f-17a2-42b6-a6cd-50e0ddd3dc87 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:47.739210 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-11b7735f-17a2-42b6-a6cd-50e0ddd3dc87 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.739862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-11b7735f-17a2-42b6-a6cd-50e0ddd3dc87 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.740664 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-11b7735f-17a2-42b6-a6cd-50e0ddd3dc87 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.741097 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-11b7735f-17a2-42b6-a6cd-50e0ddd3dc87 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.843648 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-114dcfc3-ed98-420b-801a-147ee6bdc843 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:47.853132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-114dcfc3-ed98-420b-801a-147ee6bdc843 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.333767 Dec 18 03:13:47.863309 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 93/203] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:47 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:47.879600 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3a5105a3-e6e3-438d-9a43-74c2af96e17a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:47.881072 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3a5105a3-e6e3-438d-9a43-74c2af96e17a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:47.889212 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3a5105a3-e6e3-438d-9a43-74c2af96e17a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.894462 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3a5105a3-e6e3-438d-9a43-74c2af96e17a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:47.897647 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3a5105a3-e6e3-438d-9a43-74c2af96e17a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:47.898886 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3a5105a3-e6e3-438d-9a43-74c2af96e17a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:48.275278 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-11b7735f-17a2-42b6-a6cd-50e0ddd3dc87 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:48.286112 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-11b7735f-17a2-42b6-a6cd-50e0ddd3dc87 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.579328 Dec 18 03:13:48.287546 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 111/204] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:47 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:48.292347 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3c6bb502-e18f-4cf3-8412-e35296b24610 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:48.293139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3c6bb502-e18f-4cf3-8412-e35296b24610 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:48.306299 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c6bb502-e18f-4cf3-8412-e35296b24610 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:48.307096 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c6bb502-e18f-4cf3-8412-e35296b24610 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:48.308095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c6bb502-e18f-4cf3-8412-e35296b24610 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:48.308761 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c6bb502-e18f-4cf3-8412-e35296b24610 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:48.340476 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3a5105a3-e6e3-438d-9a43-74c2af96e17a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:48.351963 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3a5105a3-e6e3-438d-9a43-74c2af96e17a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1315 microversion: 2.1 time: 0.485895 Dec 18 03:13:48.352652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 94/205] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:47 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:48.368320 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-f450a11e-6ced-43fe-83ea-1e5d55516159 req-53a0acb2-1449-4a70-98a0-6cd4034c340b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42694b52-21ac-48ab-9fbb-de90c7bcb478", "tag": "03ae95f6-837e-497f-b140-a8121c8bc611"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:48.370202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:48.370202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:13:48.379113 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-f450a11e-6ced-43fe-83ea-1e5d55516159 req-53a0acb2-1449-4a70-98a0-6cd4034c340b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:48.380164 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-f450a11e-6ced-43fe-83ea-1e5d55516159 req-53a0acb2-1449-4a70-98a0-6cd4034c340b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:48.393471 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-f450a11e-6ced-43fe-83ea-1e5d55516159 req-53a0acb2-1449-4a70-98a0-6cd4034c340b service nova] Creating event network-changed:03ae95f6-837e-497f-b140-a8121c8bc611 for instance 42694b52-21ac-48ab-9fbb-de90c7bcb478 on hv-cinder-81803 Dec 18 03:13:48.419064 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-f450a11e-6ced-43fe-83ea-1e5d55516159 req-53a0acb2-1449-4a70-98a0-6cd4034c340b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063987 Dec 18 03:13:48.419885 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 95/206] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:13:48.473957 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3c6bb502-e18f-4cf3-8412-e35296b24610 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:48.485608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3c6bb502-e18f-4cf3-8412-e35296b24610 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1271 microversion: 2.1 time: 0.196627 Dec 18 03:13:48.486272 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 112/207] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:48 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:48.634075 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9f03e51a-0a18-41c7-ba07-1207296d7094 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:48.635381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9f03e51a-0a18-41c7-ba07-1207296d7094 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:48.642013 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9f03e51a-0a18-41c7-ba07-1207296d7094 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:48.643301 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9f03e51a-0a18-41c7-ba07-1207296d7094 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:48.644665 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9f03e51a-0a18-41c7-ba07-1207296d7094 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:48.645513 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9f03e51a-0a18-41c7-ba07-1207296d7094 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:48.850501 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9f03e51a-0a18-41c7-ba07-1207296d7094 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 37327 microversion: 2.20 time: 0.220970 Dec 18 03:13:48.852010 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 96/208] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:48 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 37327 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:48.880319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-df1a33d7-b74c-4800-92b4-8bfa65ff3b39 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:48.880994 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-df1a33d7-b74c-4800-92b4-8bfa65ff3b39 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:48.887565 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-df1a33d7-b74c-4800-92b4-8bfa65ff3b39 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:48.888249 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-df1a33d7-b74c-4800-92b4-8bfa65ff3b39 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:48.889041 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-df1a33d7-b74c-4800-92b4-8bfa65ff3b39 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:48.889475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-df1a33d7-b74c-4800-92b4-8bfa65ff3b39 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:49.250005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-df1a33d7-b74c-4800-92b4-8bfa65ff3b39 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:49.257476 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-df1a33d7-b74c-4800-92b4-8bfa65ff3b39 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.380901 Dec 18 03:13:49.266220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 113/209] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:48 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:49.309437 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-27c197b0-699b-47ac-b0a6-053537d46cd2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:49.310755 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-27c197b0-699b-47ac-b0a6-053537d46cd2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:49.324114 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-27c197b0-699b-47ac-b0a6-053537d46cd2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:49.325128 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-27c197b0-699b-47ac-b0a6-053537d46cd2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:49.327901 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-27c197b0-699b-47ac-b0a6-053537d46cd2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:49.328603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-27c197b0-699b-47ac-b0a6-053537d46cd2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:49.374072 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9f597ef1-3542-4e13-88f7-c3b7d1eb5a40 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:49.374741 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9f597ef1-3542-4e13-88f7-c3b7d1eb5a40 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:49.382035 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9f597ef1-3542-4e13-88f7-c3b7d1eb5a40 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:49.394466 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9f597ef1-3542-4e13-88f7-c3b7d1eb5a40 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:49.408417 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9f597ef1-3542-4e13-88f7-c3b7d1eb5a40 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:49.409249 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9f597ef1-3542-4e13-88f7-c3b7d1eb5a40 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:49.598373 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-27c197b0-699b-47ac-b0a6-053537d46cd2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:49.609866 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-27c197b0-699b-47ac-b0a6-053537d46cd2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.306556 Dec 18 03:13:49.621048 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 97/210] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:49 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:49.628104 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0cd864a5-1ec2-48f7-90f1-f35ee6edd931 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:49.629069 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0cd864a5-1ec2-48f7-90f1-f35ee6edd931 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:49.639780 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0cd864a5-1ec2-48f7-90f1-f35ee6edd931 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:49.640323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0cd864a5-1ec2-48f7-90f1-f35ee6edd931 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:49.642151 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0cd864a5-1ec2-48f7-90f1-f35ee6edd931 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:49.642848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0cd864a5-1ec2-48f7-90f1-f35ee6edd931 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:49.698148 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9f597ef1-3542-4e13-88f7-c3b7d1eb5a40 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:49.707556 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9f597ef1-3542-4e13-88f7-c3b7d1eb5a40 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1315 microversion: 2.1 time: 0.340993 Dec 18 03:13:49.719399 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 114/211] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:49 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:49.863756 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ee40642d-e347-4c33-816b-f4ad0a82da34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:49.864721 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ee40642d-e347-4c33-816b-f4ad0a82da34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:49.879310 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0cd864a5-1ec2-48f7-90f1-f35ee6edd931 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:49.880345 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee40642d-e347-4c33-816b-f4ad0a82da34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:49.880813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee40642d-e347-4c33-816b-f4ad0a82da34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:49.881887 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee40642d-e347-4c33-816b-f4ad0a82da34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:49.883301 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee40642d-e347-4c33-816b-f4ad0a82da34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:49.902933 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0cd864a5-1ec2-48f7-90f1-f35ee6edd931 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.279849 Dec 18 03:13:49.903184 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 98/212] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:49 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:50.003394 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ee40642d-e347-4c33-816b-f4ad0a82da34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 38163 microversion: 2.20 time: 0.143240 Dec 18 03:13:50.008496 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 115/213] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:49 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 38163 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:50.282761 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7f6b093a-800e-45fb-94cf-6bb7d2d527db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:50.283659 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7f6b093a-800e-45fb-94cf-6bb7d2d527db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:50.290082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7f6b093a-800e-45fb-94cf-6bb7d2d527db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:50.290803 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7f6b093a-800e-45fb-94cf-6bb7d2d527db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:50.291594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7f6b093a-800e-45fb-94cf-6bb7d2d527db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:50.292035 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7f6b093a-800e-45fb-94cf-6bb7d2d527db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:50.483526 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-fcb0d787-fc6b-4baa-9d73-cff36933c555 req-b587dbed-2ba4-45db-9bc1-e2c7f7e81d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dcb36a5-8f79-4d98-8876-72a931e154f7", "tag": "1a6e233c-6788-4906-960d-31eabd79a5f3"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:50.485856 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:50.485856 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:13:50.497825 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-fcb0d787-fc6b-4baa-9d73-cff36933c555 req-b587dbed-2ba4-45db-9bc1-e2c7f7e81d03 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:50.499029 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-fcb0d787-fc6b-4baa-9d73-cff36933c555 req-b587dbed-2ba4-45db-9bc1-e2c7f7e81d03 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:50.514355 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-fcb0d787-fc6b-4baa-9d73-cff36933c555 req-b587dbed-2ba4-45db-9bc1-e2c7f7e81d03 service nova] Creating event network-changed:1a6e233c-6788-4906-960d-31eabd79a5f3 for instance 1dcb36a5-8f79-4d98-8876-72a931e154f7 on hv-cinder-81803 Dec 18 03:13:50.525164 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-fcb0d787-fc6b-4baa-9d73-cff36933c555 req-b587dbed-2ba4-45db-9bc1-e2c7f7e81d03 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043159 Dec 18 03:13:50.525678 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 116/214] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:13:50.588945 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7f6b093a-800e-45fb-94cf-6bb7d2d527db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:50.600762 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7f6b093a-800e-45fb-94cf-6bb7d2d527db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.321671 Dec 18 03:13:50.610590 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 99/215] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:50 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:50.627481 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d04588bb-4d42-442e-8880-d207531f770b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:50.628183 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d04588bb-4d42-442e-8880-d207531f770b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:50.636434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d04588bb-4d42-442e-8880-d207531f770b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:50.636656 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d04588bb-4d42-442e-8880-d207531f770b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:50.637440 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d04588bb-4d42-442e-8880-d207531f770b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:50.637896 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d04588bb-4d42-442e-8880-d207531f770b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:50.726645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1c6e04e0-50e4-4604-855d-f66b8b142945 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:50.727752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1c6e04e0-50e4-4604-855d-f66b8b142945 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:50.738869 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c6e04e0-50e4-4604-855d-f66b8b142945 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:50.739936 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c6e04e0-50e4-4604-855d-f66b8b142945 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:50.741222 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c6e04e0-50e4-4604-855d-f66b8b142945 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:50.742980 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c6e04e0-50e4-4604-855d-f66b8b142945 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:50.971418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d04588bb-4d42-442e-8880-d207531f770b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:50.988613 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d04588bb-4d42-442e-8880-d207531f770b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.364892 Dec 18 03:13:50.989233 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 117/216] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:50 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:51.001572 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9c1de68a-1fa4-4dcb-b310-6f4634f590e1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:51.002437 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9c1de68a-1fa4-4dcb-b310-6f4634f590e1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:51.009946 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9c1de68a-1fa4-4dcb-b310-6f4634f590e1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:51.011403 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9c1de68a-1fa4-4dcb-b310-6f4634f590e1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:51.012610 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9c1de68a-1fa4-4dcb-b310-6f4634f590e1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:51.013882 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9c1de68a-1fa4-4dcb-b310-6f4634f590e1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:51.057829 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1c6e04e0-50e4-4604-855d-f66b8b142945 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:51.066664 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1c6e04e0-50e4-4604-855d-f66b8b142945 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1315 microversion: 2.1 time: 0.344599 Dec 18 03:13:51.067996 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 100/217] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:50 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:51.073775 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-dd866ad1-118e-480a-88c3-eb27104b6cda tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:51.075095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-dd866ad1-118e-480a-88c3-eb27104b6cda tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:51.082404 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dd866ad1-118e-480a-88c3-eb27104b6cda tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:51.083193 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dd866ad1-118e-480a-88c3-eb27104b6cda tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:51.084333 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dd866ad1-118e-480a-88c3-eb27104b6cda tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:51.085103 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dd866ad1-118e-480a-88c3-eb27104b6cda tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:51.178057 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9c1de68a-1fa4-4dcb-b310-6f4634f590e1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:51.185456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9c1de68a-1fa4-4dcb-b310-6f4634f590e1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.195223 Dec 18 03:13:51.186229 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 118/218] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:50 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:51.224915 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-dd866ad1-118e-480a-88c3-eb27104b6cda tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 200 len: 38520 microversion: 2.20 time: 0.155384 Dec 18 03:13:51.227095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 101/219] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:51 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 38520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:13:51.237609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0d415baa-4ab3-4145-9e76-6275a85a6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:51.238149 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0d415baa-4ab3-4145-9e76-6275a85a6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:51.249284 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0d415baa-4ab3-4145-9e76-6275a85a6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:51.249884 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0d415baa-4ab3-4145-9e76-6275a85a6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:51.250698 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0d415baa-4ab3-4145-9e76-6275a85a6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:51.251241 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0d415baa-4ab3-4145-9e76-6275a85a6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:51.419329 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0d415baa-4ab3-4145-9e76-6275a85a6410 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/ips" status: 200 len: 151 microversion: 2.20 time: 0.185691 Dec 18 03:13:51.424899 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 119/220] 10.222.0.24 () {60 vars in 1288 bytes} [Sat Dec 18 03:13:51 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/ips => generated 151 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:13:51.622179 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0e994b33-e673-4ffe-b8a3-bc125fad2bb1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:51.624517 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0e994b33-e673-4ffe-b8a3-bc125fad2bb1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:51.634168 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0e994b33-e673-4ffe-b8a3-bc125fad2bb1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:51.636125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0e994b33-e673-4ffe-b8a3-bc125fad2bb1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:51.637665 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0e994b33-e673-4ffe-b8a3-bc125fad2bb1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:51.638664 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0e994b33-e673-4ffe-b8a3-bc125fad2bb1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:51.907205 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0e994b33-e673-4ffe-b8a3-bc125fad2bb1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:51.917078 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0e994b33-e673-4ffe-b8a3-bc125fad2bb1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.302092 Dec 18 03:13:51.918899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 102/221] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:51 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:52.006504 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4e4c9163-f982-40ca-b771-48c509c92ee5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:52.007132 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4e4c9163-f982-40ca-b771-48c509c92ee5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:52.019475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4e4c9163-f982-40ca-b771-48c509c92ee5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:52.019475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4e4c9163-f982-40ca-b771-48c509c92ee5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:52.019475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4e4c9163-f982-40ca-b771-48c509c92ee5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:52.019475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4e4c9163-f982-40ca-b771-48c509c92ee5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:52.087618 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d71a7fc8-d7d9-47bd-9fe5-b842dac2e03f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:52.089554 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d71a7fc8-d7d9-47bd-9fe5-b842dac2e03f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:52.115819 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d71a7fc8-d7d9-47bd-9fe5-b842dac2e03f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:52.118129 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d71a7fc8-d7d9-47bd-9fe5-b842dac2e03f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:52.120467 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d71a7fc8-d7d9-47bd-9fe5-b842dac2e03f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:52.122011 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d71a7fc8-d7d9-47bd-9fe5-b842dac2e03f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:52.247471 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4e4c9163-f982-40ca-b771-48c509c92ee5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:52.258600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4e4c9163-f982-40ca-b771-48c509c92ee5 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.255650 Dec 18 03:13:52.259170 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 120/222] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:52 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:52.276195 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a7a38dff-d75d-4dbf-a303-8d44f2bc67cd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:52.278741 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a7a38dff-d75d-4dbf-a303-8d44f2bc67cd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:52.295217 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a7a38dff-d75d-4dbf-a303-8d44f2bc67cd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:52.295758 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a7a38dff-d75d-4dbf-a303-8d44f2bc67cd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:52.296447 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a7a38dff-d75d-4dbf-a303-8d44f2bc67cd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:52.300554 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a7a38dff-d75d-4dbf-a303-8d44f2bc67cd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:52.340730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d71a7fc8-d7d9-47bd-9fe5-b842dac2e03f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:52.350320 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d71a7fc8-d7d9-47bd-9fe5-b842dac2e03f tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1315 microversion: 2.1 time: 0.269625 Dec 18 03:13:52.352466 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 103/223] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:52 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:52.568363 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a7a38dff-d75d-4dbf-a303-8d44f2bc67cd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:52.581457 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a7a38dff-d75d-4dbf-a303-8d44f2bc67cd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.318115 Dec 18 03:13:52.582314 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 121/224] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:52 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:52.934137 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cf38c844-66e5-45dd-aa2d-d7c7dadeb748 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:52.934748 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cf38c844-66e5-45dd-aa2d-d7c7dadeb748 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:52.942182 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cf38c844-66e5-45dd-aa2d-d7c7dadeb748 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:52.942730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cf38c844-66e5-45dd-aa2d-d7c7dadeb748 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:52.943610 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cf38c844-66e5-45dd-aa2d-d7c7dadeb748 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:52.944214 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cf38c844-66e5-45dd-aa2d-d7c7dadeb748 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:53.088068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-cf38c844-66e5-45dd-aa2d-d7c7dadeb748 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:53.095877 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cf38c844-66e5-45dd-aa2d-d7c7dadeb748 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.165162 Dec 18 03:13:53.096535 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 104/225] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:52 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:53.275448 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b412bbef-4ddb-4c54-9dfe-382bd5fc95be tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:53.276126 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b412bbef-4ddb-4c54-9dfe-382bd5fc95be tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:53.282196 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b412bbef-4ddb-4c54-9dfe-382bd5fc95be tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:53.282643 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b412bbef-4ddb-4c54-9dfe-382bd5fc95be tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:53.283418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b412bbef-4ddb-4c54-9dfe-382bd5fc95be tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:53.283849 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b412bbef-4ddb-4c54-9dfe-382bd5fc95be tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:53.368752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f358931d-59e3-4953-9bb1-a5953e6407e8 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:53.369570 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f358931d-59e3-4953-9bb1-a5953e6407e8 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:53.375724 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f358931d-59e3-4953-9bb1-a5953e6407e8 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:53.376169 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f358931d-59e3-4953-9bb1-a5953e6407e8 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:53.376958 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f358931d-59e3-4953-9bb1-a5953e6407e8 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:53.377387 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f358931d-59e3-4953-9bb1-a5953e6407e8 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:53.435036 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b412bbef-4ddb-4c54-9dfe-382bd5fc95be tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:53.454227 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b412bbef-4ddb-4c54-9dfe-382bd5fc95be tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.182862 Dec 18 03:13:53.466708 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 122/226] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:53 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:53.548437 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f358931d-59e3-4953-9bb1-a5953e6407e8 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:53.558329 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f358931d-59e3-4953-9bb1-a5953e6407e8 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1315 microversion: 2.1 time: 0.193620 Dec 18 03:13:53.567815 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 105/227] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:53 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:53.599072 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d4afd461-3201-4aed-9775-5755fe5074e0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:53.599842 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d4afd461-3201-4aed-9775-5755fe5074e0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:53.606183 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4afd461-3201-4aed-9775-5755fe5074e0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:53.606630 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4afd461-3201-4aed-9775-5755fe5074e0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:53.607411 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4afd461-3201-4aed-9775-5755fe5074e0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:53.607841 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4afd461-3201-4aed-9775-5755fe5074e0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:53.690217 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bbd86382-8709-4836-b9eb-ccef582f1586 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:53.690937 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bbd86382-8709-4836-b9eb-ccef582f1586 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:53.697285 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbd86382-8709-4836-b9eb-ccef582f1586 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:53.700810 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbd86382-8709-4836-b9eb-ccef582f1586 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:53.701652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbd86382-8709-4836-b9eb-ccef582f1586 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:53.707952 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbd86382-8709-4836-b9eb-ccef582f1586 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:53.739223 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-bbd86382-8709-4836-b9eb-ccef582f1586 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lazy-loading 'flavor' on Instance uuid aaa82caa-8340-4f50-9989-2ddbc243fb40 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:13:53.797926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d4afd461-3201-4aed-9775-5755fe5074e0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:53.806594 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d4afd461-3201-4aed-9775-5755fe5074e0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.211127 Dec 18 03:13:53.807014 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 123/228] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:53 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:54.025333 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bbd86382-8709-4836-b9eb-ccef582f1586 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 202 len: 0 microversion: 2.20 time: 0.339496 Dec 18 03:13:54.029304 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 106/229] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:13:53 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:13:54.035216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:54.035884 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:54.049036 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.050394 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.051887 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.052545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.114594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0fd8c54a-bb9d-4339-883f-80609eafe598 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:54.115418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0fd8c54a-bb9d-4339-883f-80609eafe598 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:54.122750 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0fd8c54a-bb9d-4339-883f-80609eafe598 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.123286 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0fd8c54a-bb9d-4339-883f-80609eafe598 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.124146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0fd8c54a-bb9d-4339-883f-80609eafe598 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.124813 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0fd8c54a-bb9d-4339-883f-80609eafe598 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.234756 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:54.246266 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:54.247758 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:54.249283 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5c452f59-7147-4308-80b9-e723c70f74e0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.218282 Dec 18 03:13:54.250049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 124/230] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:13:54 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:13:54.275034 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-e047939e-6fba-43f3-a415-fa11dca2646e req-40c9a669-6a3b-441d-ae2a-8e8a292b7f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7171a8a-454c-4893-9d06-482322c37d16", "name": "network-vif-plugged", "status": "completed", "tag": "89c9d737-9fbe-413b-94fc-e8c0330894d5"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:54.277025 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:54.277025 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:13:54.291874 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-e047939e-6fba-43f3-a415-fa11dca2646e req-40c9a669-6a3b-441d-ae2a-8e8a292b7f70 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.292509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-e047939e-6fba-43f3-a415-fa11dca2646e req-40c9a669-6a3b-441d-ae2a-8e8a292b7f70 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.303937 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0fd8c54a-bb9d-4339-883f-80609eafe598 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:54.311985 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-e047939e-6fba-43f3-a415-fa11dca2646e req-40c9a669-6a3b-441d-ae2a-8e8a292b7f70 service nova] Creating event network-vif-plugged:89c9d737-9fbe-413b-94fc-e8c0330894d5 for instance d7171a8a-454c-4893-9d06-482322c37d16 on hv-cinder-81803 Dec 18 03:13:54.312967 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0fd8c54a-bb9d-4339-883f-80609eafe598 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.202688 Dec 18 03:13:54.314491 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 107/231] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:54 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:54.318785 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-e047939e-6fba-43f3-a415-fa11dca2646e req-40c9a669-6a3b-441d-ae2a-8e8a292b7f70 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049189 Dec 18 03:13:54.321259 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 125/232] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:13:54.479665 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e1fa867a-f319-42e1-b1d7-5e45aea2a632 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:54.481437 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e1fa867a-f319-42e1-b1d7-5e45aea2a632 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:54.487887 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e1fa867a-f319-42e1-b1d7-5e45aea2a632 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.488335 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e1fa867a-f319-42e1-b1d7-5e45aea2a632 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.489107 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e1fa867a-f319-42e1-b1d7-5e45aea2a632 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.489715 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e1fa867a-f319-42e1-b1d7-5e45aea2a632 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.577512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e3d8b574-6970-4c70-9a95-cca8c2ee364a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:54.578615 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e3d8b574-6970-4c70-9a95-cca8c2ee364a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:54.585306 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e3d8b574-6970-4c70-9a95-cca8c2ee364a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.586165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e3d8b574-6970-4c70-9a95-cca8c2ee364a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.587220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e3d8b574-6970-4c70-9a95-cca8c2ee364a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.588264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e3d8b574-6970-4c70-9a95-cca8c2ee364a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.736899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e1fa867a-f319-42e1-b1d7-5e45aea2a632 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:54.746402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e1fa867a-f319-42e1-b1d7-5e45aea2a632 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.276701 Dec 18 03:13:54.756073 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 108/233] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:54 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:54.768631 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e3d8b574-6970-4c70-9a95-cca8c2ee364a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:54.777582 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e3d8b574-6970-4c70-9a95-cca8c2ee364a tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1315 microversion: 2.1 time: 0.204782 Dec 18 03:13:54.778223 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 126/234] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:54 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:54.823776 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4c38f2cb-7f58-474b-a44c-bd8a3167a143 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:54.824480 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4c38f2cb-7f58-474b-a44c-bd8a3167a143 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:54.830357 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4c38f2cb-7f58-474b-a44c-bd8a3167a143 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.830804 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4c38f2cb-7f58-474b-a44c-bd8a3167a143 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.831677 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4c38f2cb-7f58-474b-a44c-bd8a3167a143 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:54.832184 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4c38f2cb-7f58-474b-a44c-bd8a3167a143 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:54.972957 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4c38f2cb-7f58-474b-a44c-bd8a3167a143 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:54.981578 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4c38f2cb-7f58-474b-a44c-bd8a3167a143 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.162529 Dec 18 03:13:54.982184 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 109/235] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:54 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:55.268242 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:55.268792 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:55.276472 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:55.277442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:55.278964 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:55.279402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:55.330693 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b698c40a-eb46-42f0-877e-1cf44d27517e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:55.331307 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b698c40a-eb46-42f0-877e-1cf44d27517e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:55.337435 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b698c40a-eb46-42f0-877e-1cf44d27517e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:55.338154 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b698c40a-eb46-42f0-877e-1cf44d27517e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:55.338943 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b698c40a-eb46-42f0-877e-1cf44d27517e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:55.339370 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b698c40a-eb46-42f0-877e-1cf44d27517e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:55.426872 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:55.435878 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:55.437425 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:55.438851 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c5ee4ba0-07f8-4dff-b5c3-8a3e572a6437 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.174350 Dec 18 03:13:55.439566 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 127/236] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:13:55 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:13:55.480094 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b698c40a-eb46-42f0-877e-1cf44d27517e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:55.487998 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b698c40a-eb46-42f0-877e-1cf44d27517e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.161066 Dec 18 03:13:55.488602 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 110/237] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:55 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:55.763200 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6b3ce908-762b-4b58-84fb-1f0a82a32270 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:55.763797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6b3ce908-762b-4b58-84fb-1f0a82a32270 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:55.770335 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6b3ce908-762b-4b58-84fb-1f0a82a32270 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:55.770877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6b3ce908-762b-4b58-84fb-1f0a82a32270 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:55.771744 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6b3ce908-762b-4b58-84fb-1f0a82a32270 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:55.772258 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6b3ce908-762b-4b58-84fb-1f0a82a32270 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:55.794347 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c78c7a38-6065-4e05-98b0-b599aa70305c tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:55.795040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c78c7a38-6065-4e05-98b0-b599aa70305c tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:55.800908 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c78c7a38-6065-4e05-98b0-b599aa70305c tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:55.801378 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c78c7a38-6065-4e05-98b0-b599aa70305c tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:55.802240 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c78c7a38-6065-4e05-98b0-b599aa70305c tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:55.802669 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c78c7a38-6065-4e05-98b0-b599aa70305c tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:55.915359 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6b3ce908-762b-4b58-84fb-1f0a82a32270 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:55.923304 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6b3ce908-762b-4b58-84fb-1f0a82a32270 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.163607 Dec 18 03:13:55.924020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 128/238] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:55 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:55.953681 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c78c7a38-6065-4e05-98b0-b599aa70305c tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:55.961401 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c78c7a38-6065-4e05-98b0-b599aa70305c tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1315 microversion: 2.1 time: 0.170688 Dec 18 03:13:55.961973 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 111/239] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:55 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:55.997474 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-46f41d48-06d3-4e11-9883-d66eee1e099f tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:55.998114 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-46f41d48-06d3-4e11-9883-d66eee1e099f tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:56.003875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46f41d48-06d3-4e11-9883-d66eee1e099f tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.004319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46f41d48-06d3-4e11-9883-d66eee1e099f tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:56.005084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46f41d48-06d3-4e11-9883-d66eee1e099f tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.005517 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46f41d48-06d3-4e11-9883-d66eee1e099f tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:56.144097 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-46f41d48-06d3-4e11-9883-d66eee1e099f tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:56.151978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-46f41d48-06d3-4e11-9883-d66eee1e099f tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.158110 Dec 18 03:13:56.152533 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 129/240] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:55 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:56.457881 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:56.458488 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:56.464890 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.465334 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:56.466132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.466569 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:56.504429 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c35e808b-2486-4b94-8d28-f174d95cc856 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:56.505146 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c35e808b-2486-4b94-8d28-f174d95cc856 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:56.511688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c35e808b-2486-4b94-8d28-f174d95cc856 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.512129 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c35e808b-2486-4b94-8d28-f174d95cc856 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:56.512900 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c35e808b-2486-4b94-8d28-f174d95cc856 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.513325 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c35e808b-2486-4b94-8d28-f174d95cc856 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:56.598460 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:56.607254 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:56.608772 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:56.609947 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8f049695-6bac-44d0-8544-fb5f8b925a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.155814 Dec 18 03:13:56.610507 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 112/241] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:13:56 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:13:56.644639 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c35e808b-2486-4b94-8d28-f174d95cc856 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:56.651798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c35e808b-2486-4b94-8d28-f174d95cc856 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.150919 Dec 18 03:13:56.652361 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 130/242] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:56 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:56.940280 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bf23608c-9e5a-4441-9246-ed40f68759ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:56.940916 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bf23608c-9e5a-4441-9246-ed40f68759ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:56.947493 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf23608c-9e5a-4441-9246-ed40f68759ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.947937 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf23608c-9e5a-4441-9246-ed40f68759ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:56.948704 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf23608c-9e5a-4441-9246-ed40f68759ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.949136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf23608c-9e5a-4441-9246-ed40f68759ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:56.979291 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-cf572385-77c3-436d-b3d7-213d50448207 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:56.980507 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-cf572385-77c3-436d-b3d7-213d50448207 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:56.987136 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cf572385-77c3-436d-b3d7-213d50448207 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.987666 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cf572385-77c3-436d-b3d7-213d50448207 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:56.988458 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cf572385-77c3-436d-b3d7-213d50448207 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:56.988917 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cf572385-77c3-436d-b3d7-213d50448207 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.085835 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bf23608c-9e5a-4441-9246-ed40f68759ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:57.094668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bf23608c-9e5a-4441-9246-ed40f68759ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.157888 Dec 18 03:13:57.095957 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 113/243] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:56 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:57.134326 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-cf572385-77c3-436d-b3d7-213d50448207 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:57.142010 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-cf572385-77c3-436d-b3d7-213d50448207 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1464 microversion: 2.1 time: 0.167505 Dec 18 03:13:57.143174 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 131/244] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:56 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:57.168732 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3f22d721-e923-4b40-8458-ad19c63a88dc tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:57.169476 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3f22d721-e923-4b40-8458-ad19c63a88dc tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:57.176796 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f22d721-e923-4b40-8458-ad19c63a88dc tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.182835 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-28ce9e5c-109b-4b2e-8464-04d6c8ffe2e6 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:57.183369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f22d721-e923-4b40-8458-ad19c63a88dc tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.183505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-28ce9e5c-109b-4b2e-8464-04d6c8ffe2e6 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:57.184257 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f22d721-e923-4b40-8458-ad19c63a88dc tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.184700 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f22d721-e923-4b40-8458-ad19c63a88dc tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.189426 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-28ce9e5c-109b-4b2e-8464-04d6c8ffe2e6 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.190004 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-28ce9e5c-109b-4b2e-8464-04d6c8ffe2e6 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.190956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-28ce9e5c-109b-4b2e-8464-04d6c8ffe2e6 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.191434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-28ce9e5c-109b-4b2e-8464-04d6c8ffe2e6 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.216910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-28ce9e5c-109b-4b2e-8464-04d6c8ffe2e6 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:13:57.317247 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-28ce9e5c-109b-4b2e-8464-04d6c8ffe2e6 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 204 len: 0 microversion: 2.1 time: 0.138964 Dec 18 03:13:57.323505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 132/245] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:13:57 2021] DELETE /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:13:57.328547 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b1e5e9ae-a69b-4b06-b0a5-4d93a0e96e4d tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:57.329245 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b1e5e9ae-a69b-4b06-b0a5-4d93a0e96e4d tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:57.332692 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3f22d721-e923-4b40-8458-ad19c63a88dc tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:57.342855 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3f22d721-e923-4b40-8458-ad19c63a88dc tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.176151 Dec 18 03:13:57.345670 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 114/246] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:57 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:57.347644 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b1e5e9ae-a69b-4b06-b0a5-4d93a0e96e4d tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.348129 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b1e5e9ae-a69b-4b06-b0a5-4d93a0e96e4d tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.348887 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b1e5e9ae-a69b-4b06-b0a5-4d93a0e96e4d tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.349298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b1e5e9ae-a69b-4b06-b0a5-4d93a0e96e4d tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.548516 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b1e5e9ae-a69b-4b06-b0a5-4d93a0e96e4d tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:57.556776 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b1e5e9ae-a69b-4b06-b0a5-4d93a0e96e4d tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1470 microversion: 2.1 time: 0.232016 Dec 18 03:13:57.557472 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 133/247] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:57 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1470 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:57.628308 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:57.628918 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:57.635859 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.636317 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.637253 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.637888 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.668590 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-edb12430-fa04-41c0-83c4-15c339e989a2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:57.669309 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-edb12430-fa04-41c0-83c4-15c339e989a2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:57.676742 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-edb12430-fa04-41c0-83c4-15c339e989a2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.677198 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-edb12430-fa04-41c0-83c4-15c339e989a2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.678026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-edb12430-fa04-41c0-83c4-15c339e989a2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:57.678463 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-edb12430-fa04-41c0-83c4-15c339e989a2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:57.836561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:57.848198 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:57.849881 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:57.851690 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cdde88c9-2a89-4f73-a7bb-a091a09a627a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.226866 Dec 18 03:13:57.852367 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 115/248] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:13:57 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:13:57.880736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-edb12430-fa04-41c0-83c4-15c339e989a2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:57.891798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-edb12430-fa04-41c0-83c4-15c339e989a2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.227126 Dec 18 03:13:57.892681 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 134/249] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:57 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:58.093280 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-915ed9ee-632b-4c11-83a7-2b1bc5942bbf req-21e7fc33-b4d3-4932-9414-ceafd91ddefc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42694b52-21ac-48ab-9fbb-de90c7bcb478", "name": "network-vif-plugged", "status": "completed", "tag": "03ae95f6-837e-497f-b140-a8121c8bc611"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:13:58.095065 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:13:58.095065 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:13:58.104611 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-915ed9ee-632b-4c11-83a7-2b1bc5942bbf req-21e7fc33-b4d3-4932-9414-ceafd91ddefc service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.105404 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-915ed9ee-632b-4c11-83a7-2b1bc5942bbf req-21e7fc33-b4d3-4932-9414-ceafd91ddefc service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.111898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a37c4787-b505-4a4c-9d21-7f64239ae274 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:58.112725 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a37c4787-b505-4a4c-9d21-7f64239ae274 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:58.121134 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a37c4787-b505-4a4c-9d21-7f64239ae274 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.121821 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a37c4787-b505-4a4c-9d21-7f64239ae274 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.122789 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a37c4787-b505-4a4c-9d21-7f64239ae274 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.123337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a37c4787-b505-4a4c-9d21-7f64239ae274 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.129357 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-915ed9ee-632b-4c11-83a7-2b1bc5942bbf req-21e7fc33-b4d3-4932-9414-ceafd91ddefc service nova] Creating event network-vif-plugged:03ae95f6-837e-497f-b140-a8121c8bc611 for instance 42694b52-21ac-48ab-9fbb-de90c7bcb478 on hv-cinder-81803 Dec 18 03:13:58.136397 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-915ed9ee-632b-4c11-83a7-2b1bc5942bbf req-21e7fc33-b4d3-4932-9414-ceafd91ddefc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046634 Dec 18 03:13:58.137591 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 116/250] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:13:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:13:58.309574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a37c4787-b505-4a4c-9d21-7f64239ae274 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:58.316718 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a37c4787-b505-4a4c-9d21-7f64239ae274 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.208255 Dec 18 03:13:58.318191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 135/251] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:58 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:58.362955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e3fb3ae7-7747-4d9c-b53b-5d8e0cd07eee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:58.363911 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e3fb3ae7-7747-4d9c-b53b-5d8e0cd07eee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:58.370845 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e3fb3ae7-7747-4d9c-b53b-5d8e0cd07eee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.371295 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e3fb3ae7-7747-4d9c-b53b-5d8e0cd07eee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.372097 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e3fb3ae7-7747-4d9c-b53b-5d8e0cd07eee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.372713 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e3fb3ae7-7747-4d9c-b53b-5d8e0cd07eee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.568489 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e3fb3ae7-7747-4d9c-b53b-5d8e0cd07eee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:58.573977 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-12a20085-25aa-4ea7-b255-123ce4e2dbf9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:58.574701 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-12a20085-25aa-4ea7-b255-123ce4e2dbf9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:58.579752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e3fb3ae7-7747-4d9c-b53b-5d8e0cd07eee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.221972 Dec 18 03:13:58.580343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 117/252] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:58 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:58.589929 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-12a20085-25aa-4ea7-b255-123ce4e2dbf9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.589929 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-12a20085-25aa-4ea7-b255-123ce4e2dbf9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.589929 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-12a20085-25aa-4ea7-b255-123ce4e2dbf9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.589929 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-12a20085-25aa-4ea7-b255-123ce4e2dbf9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.724868 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-12a20085-25aa-4ea7-b255-123ce4e2dbf9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:58.733127 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-12a20085-25aa-4ea7-b255-123ce4e2dbf9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1470 microversion: 2.1 time: 0.163680 Dec 18 03:13:58.733720 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 136/253] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:58 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:58.870732 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:58.871376 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:58.877179 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.877652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.878429 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.878866 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.908943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3c11da80-ca9c-4077-86af-a6588a56763a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:58.909680 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3c11da80-ca9c-4077-86af-a6588a56763a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:58.917649 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c11da80-ca9c-4077-86af-a6588a56763a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.918589 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c11da80-ca9c-4077-86af-a6588a56763a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:58.919656 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c11da80-ca9c-4077-86af-a6588a56763a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:58.920249 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c11da80-ca9c-4077-86af-a6588a56763a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:59.067017 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:59.075848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:59.077848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:59.079329 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9cd0e305-b1cd-40ad-baee-b28017cc0a98 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.212351 Dec 18 03:13:59.080136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 118/254] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:13:58 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:13:59.107134 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3c11da80-ca9c-4077-86af-a6588a56763a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:59.115067 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3c11da80-ca9c-4077-86af-a6588a56763a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.210328 Dec 18 03:13:59.115639 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 137/255] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:58 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:13:59.335704 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3b788a38-e849-45fa-b2fa-a9a9344b2e71 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:59.337151 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3b788a38-e849-45fa-b2fa-a9a9344b2e71 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:59.343402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3b788a38-e849-45fa-b2fa-a9a9344b2e71 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:59.343991 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3b788a38-e849-45fa-b2fa-a9a9344b2e71 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:59.345069 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3b788a38-e849-45fa-b2fa-a9a9344b2e71 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:59.345846 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3b788a38-e849-45fa-b2fa-a9a9344b2e71 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:59.596374 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5dd68123-528f-4781-9ec3-8485d9b9ffc6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:59.597597 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5dd68123-528f-4781-9ec3-8485d9b9ffc6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:59.605297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5dd68123-528f-4781-9ec3-8485d9b9ffc6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:59.605967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5dd68123-528f-4781-9ec3-8485d9b9ffc6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:59.606957 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5dd68123-528f-4781-9ec3-8485d9b9ffc6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:59.607534 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5dd68123-528f-4781-9ec3-8485d9b9ffc6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:59.887569 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5dd68123-528f-4781-9ec3-8485d9b9ffc6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:59.901540 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5dd68123-528f-4781-9ec3-8485d9b9ffc6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.308413 Dec 18 03:13:59.902550 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 138/256] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:59 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:13:59.912063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-67da8d81-c67d-4ffe-9139-4d23b9f30bec tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:13:59.913483 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-67da8d81-c67d-4ffe-9139-4d23b9f30bec tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:13:59.927327 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67da8d81-c67d-4ffe-9139-4d23b9f30bec tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:59.928203 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67da8d81-c67d-4ffe-9139-4d23b9f30bec tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:59.929791 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67da8d81-c67d-4ffe-9139-4d23b9f30bec tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:13:59.930580 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67da8d81-c67d-4ffe-9139-4d23b9f30bec tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:13:59.981935 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3b788a38-e849-45fa-b2fa-a9a9344b2e71 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:13:59.994360 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3b788a38-e849-45fa-b2fa-a9a9344b2e71 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1317 microversion: 2.1 time: 0.661747 Dec 18 03:13:59.995458 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 119/257] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:59 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1317 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:00.101894 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:00.102832 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:00.112872 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:00.113457 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:00.114401 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:00.114939 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:00.194489 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-67da8d81-c67d-4ffe-9139-4d23b9f30bec tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:00.219855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-67da8d81-c67d-4ffe-9139-4d23b9f30bec tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1470 microversion: 2.1 time: 0.315559 Dec 18 03:14:00.231833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 139/258] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:13:59 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:00.245658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ff123b18-70d6-4dfd-ad77-e197a948986f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:00.246479 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ff123b18-70d6-4dfd-ad77-e197a948986f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:00.253037 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff123b18-70d6-4dfd-ad77-e197a948986f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:00.253649 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff123b18-70d6-4dfd-ad77-e197a948986f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:00.254536 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff123b18-70d6-4dfd-ad77-e197a948986f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:00.255041 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff123b18-70d6-4dfd-ad77-e197a948986f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:00.447052 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ff123b18-70d6-4dfd-ad77-e197a948986f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:00.456332 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ff123b18-70d6-4dfd-ad77-e197a948986f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.223297 Dec 18 03:14:00.457706 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 140/259] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:00 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:00.459822 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:00.463369 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-c368b853-4580-4fdc-92a5-a5395cac6b90 req-dce05615-69a5-408d-b94c-14cdb4fc246b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcb36a5-8f79-4d98-8876-72a931e154f7", "name": "network-vif-plugged", "status": "completed", "tag": "1a6e233c-6788-4906-960d-31eabd79a5f3"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:00.465150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:00.465150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:14:00.472241 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-c368b853-4580-4fdc-92a5-a5395cac6b90 req-dce05615-69a5-408d-b94c-14cdb4fc246b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:00.472940 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-c368b853-4580-4fdc-92a5-a5395cac6b90 req-dce05615-69a5-408d-b94c-14cdb4fc246b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:00.475175 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:00.477219 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:00.478493 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9e3ba0a3-c31c-4c18-abdd-75579343dd7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.381788 Dec 18 03:14:00.480815 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 120/260] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:00 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:00.496401 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-c368b853-4580-4fdc-92a5-a5395cac6b90 req-dce05615-69a5-408d-b94c-14cdb4fc246b service nova] Creating event network-vif-plugged:1a6e233c-6788-4906-960d-31eabd79a5f3 for instance 1dcb36a5-8f79-4d98-8876-72a931e154f7 on hv-cinder-81803 Dec 18 03:14:00.501515 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-c368b853-4580-4fdc-92a5-a5395cac6b90 req-dce05615-69a5-408d-b94c-14cdb4fc246b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042061 Dec 18 03:14:00.502504 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 141/261] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:00.918793 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0ecc6fd5-a0d2-455a-9012-4709c456a7fd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:00.919399 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0ecc6fd5-a0d2-455a-9012-4709c456a7fd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:00.925658 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0ecc6fd5-a0d2-455a-9012-4709c456a7fd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:00.926103 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0ecc6fd5-a0d2-455a-9012-4709c456a7fd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:00.927069 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0ecc6fd5-a0d2-455a-9012-4709c456a7fd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:00.927650 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0ecc6fd5-a0d2-455a-9012-4709c456a7fd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.008091 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-36080dc5-30f5-4ceb-a0d0-98a642be5c36 req-fc033bf7-b2fe-4ce3-adb1-c4d4363bf63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7171a8a-454c-4893-9d06-482322c37d16", "name": "network-vif-deleted", "tag": "89c9d737-9fbe-413b-94fc-e8c0330894d5"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:01.009686 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:01.009686 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:14:01.016875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-36080dc5-30f5-4ceb-a0d0-98a642be5c36 req-fc033bf7-b2fe-4ce3-adb1-c4d4363bf63b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.017311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-36080dc5-30f5-4ceb-a0d0-98a642be5c36 req-fc033bf7-b2fe-4ce3-adb1-c4d4363bf63b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.028559 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-36080dc5-30f5-4ceb-a0d0-98a642be5c36 req-fc033bf7-b2fe-4ce3-adb1-c4d4363bf63b service nova] Creating event network-vif-deleted:89c9d737-9fbe-413b-94fc-e8c0330894d5 for instance d7171a8a-454c-4893-9d06-482322c37d16 on hv-cinder-81803 Dec 18 03:14:01.035618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-36080dc5-30f5-4ceb-a0d0-98a642be5c36 req-fc033bf7-b2fe-4ce3-adb1-c4d4363bf63b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033423 Dec 18 03:14:01.035618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 142/262] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:14:01.044239 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-85ff13c1-bb4e-413c-abe3-687b18201742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:01.045002 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-85ff13c1-bb4e-413c-abe3-687b18201742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:01.051464 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-85ff13c1-bb4e-413c-abe3-687b18201742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.051901 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-85ff13c1-bb4e-413c-abe3-687b18201742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.052856 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-85ff13c1-bb4e-413c-abe3-687b18201742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.053286 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-85ff13c1-bb4e-413c-abe3-687b18201742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.188171 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0ecc6fd5-a0d2-455a-9012-4709c456a7fd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:01.196148 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0ecc6fd5-a0d2-455a-9012-4709c456a7fd tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.280919 Dec 18 03:14:01.197298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 121/263] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:00 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:01.206758 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-85ff13c1-bb4e-413c-abe3-687b18201742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:01.216496 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-85ff13c1-bb4e-413c-abe3-687b18201742 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1508 microversion: 2.1 time: 0.179809 Dec 18 03:14:01.217200 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 143/264] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:01 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:01.250213 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:01.252111 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:01.260133 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.260929 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.261955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.262545 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.297285 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.298233 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.298968 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lazy-loading 'fault' on Instance uuid d7171a8a-454c-4893-9d06-482322c37d16 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:14:01.349785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cafa92761a4f568af959a44d6ba1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a0c96a8b9042b985620098618d5fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:01.358744 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ab0ab26a-14e1-4774-97b7-c2422ffb6c58 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 200 len: 1305 microversion: 2.1 time: 0.114219 Dec 18 03:14:01.359329 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 122/265] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:01 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:01.473603 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e2c9a6d0-31c7-4cc7-9803-151e1ca668e2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:01.474500 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e2c9a6d0-31c7-4cc7-9803-151e1ca668e2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:01.482648 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e2c9a6d0-31c7-4cc7-9803-151e1ca668e2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.483353 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e2c9a6d0-31c7-4cc7-9803-151e1ca668e2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.484384 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e2c9a6d0-31c7-4cc7-9803-151e1ca668e2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.485040 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e2c9a6d0-31c7-4cc7-9803-151e1ca668e2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.500251 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:01.500251 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:01.506859 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.508034 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.510800 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:01.510800 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:01.676395 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e2c9a6d0-31c7-4cc7-9803-151e1ca668e2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:01.685170 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e2c9a6d0-31c7-4cc7-9803-151e1ca668e2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.215132 Dec 18 03:14:01.689107 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:01.695357 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 144/266] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:01 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:01.698653 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:01.700152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:01.701311 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2b300300-4f27-4155-8501-9a5dc2e45253 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.206598 Dec 18 03:14:01.701892 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 123/267] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:01 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:14:02.053541 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1728874368", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "networks": [{"uuid": "8ae16f07-c695-4581-a1d1-000cf62d9722"}]}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:02.114020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] validate_networks() for [('8ae16f07-c695-4581-a1d1-000cf62d9722', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:14:02.213592 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5f6e06d9-41e9-431c-8067-a54b5d11e8f7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:02.214816 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5f6e06d9-41e9-431c-8067-a54b5d11e8f7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:02.220949 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5f6e06d9-41e9-431c-8067-a54b5d11e8f7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.221392 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5f6e06d9-41e9-431c-8067-a54b5d11e8f7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.222388 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5f6e06d9-41e9-431c-8067-a54b5d11e8f7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.222821 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5f6e06d9-41e9-431c-8067-a54b5d11e8f7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.359116 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5f6e06d9-41e9-431c-8067-a54b5d11e8f7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:02.371967 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5f6e06d9-41e9-431c-8067-a54b5d11e8f7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1313 microversion: 2.1 time: 0.162842 Dec 18 03:14:02.373435 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 124/268] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:02 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:02.379370 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d70199a4-fd10-4ed6-90db-d5174013f4a9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:02.380911 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d70199a4-fd10-4ed6-90db-d5174013f4a9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] [instance: d7171a8a-454c-4893-9d06-482322c37d16] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:02.390192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d70199a4-fd10-4ed6-90db-d5174013f4a9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.390635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d70199a4-fd10-4ed6-90db-d5174013f4a9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.391548 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d70199a4-fd10-4ed6-90db-d5174013f4a9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.392149 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d70199a4-fd10-4ed6-90db-d5174013f4a9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.407073 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-d70199a4-fd10-4ed6-90db-d5174013f4a9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] HTTP exception thrown: Instance d7171a8a-454c-4893-9d06-482322c37d16 could not be found. Dec 18 03:14:02.407929 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d70199a4-fd10-4ed6-90db-d5174013f4a9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] Returning 404 to user: Instance d7171a8a-454c-4893-9d06-482322c37d16 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:14:02.408942 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d70199a4-fd10-4ed6-90db-d5174013f4a9 tempest-VolumesNegativeTest-1851494833 tempest-VolumesNegativeTest-1851494833-project] 10.222.0.24 "GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16" status: 404 len: 111 microversion: 2.1 time: 0.034341 Dec 18 03:14:02.412126 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 125/269] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:02 2021] GET /compute/v2.1/servers/d7171a8a-454c-4893-9d06-482322c37d16 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:14:02.516644 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:14:02.517298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:14:02.517938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:14:02.518539 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:14:02.519098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:14:02.531789 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.532235 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.533042 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.533469 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.552216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Getting quotas for project 2332e8c0e55443e4850ccea9e08376d9. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:14:02.556839 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Getting quotas for user cbac9dd3aff24720b114c16fac5bee71 and project 2332e8c0e55443e4850ccea9e08376d9. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:14:02.568181 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:14:02.570542 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:14:02.629365 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c2ceb727-85e3-4861-9fd7-10aa7270a12b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578908 Dec 18 03:14:02.630818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 145/270] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:14:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:14:02.631212 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d7d70064-0048-455b-b1d6-78a97125022c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a1a6ed9-c3b2-4b17-a5cd-b0b9b67c65d2"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:02.632569 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d7d70064-0048-455b-b1d6-78a97125022c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:02.641940 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d7d70064-0048-455b-b1d6-78a97125022c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.642581 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d7d70064-0048-455b-b1d6-78a97125022c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.643556 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d7d70064-0048-455b-b1d6-78a97125022c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.644165 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d7d70064-0048-455b-b1d6-78a97125022c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.647271 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-015d942f-c6b1-4d15-9973-374f23e2e805 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:02.651294 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-015d942f-c6b1-4d15-9973-374f23e2e805 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:02.745003 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-015d942f-c6b1-4d15-9973-374f23e2e805 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:02.762317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-015d942f-c6b1-4d15-9973-374f23e2e805 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1219 microversion: 2.1 time: 0.116238 Dec 18 03:14:02.763205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 146/271] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:02 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:02.773903 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-525eb1b5-738f-4ce2-b9fb-6c374a06c009 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:02.774515 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-525eb1b5-738f-4ce2-b9fb-6c374a06c009 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:02.781723 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-525eb1b5-738f-4ce2-b9fb-6c374a06c009 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.782183 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-525eb1b5-738f-4ce2-b9fb-6c374a06c009 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.783518 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-525eb1b5-738f-4ce2-b9fb-6c374a06c009 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.783963 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-525eb1b5-738f-4ce2-b9fb-6c374a06c009 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.943654 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-525eb1b5-738f-4ce2-b9fb-6c374a06c009 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:02.951946 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-525eb1b5-738f-4ce2-b9fb-6c374a06c009 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.184904 Dec 18 03:14:02.970889 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 147/272] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:02 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:02.985328 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:02.985975 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:02.995567 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.996036 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:02.996833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:02.997264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:03.057587 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d7d70064-0048-455b-b1d6-78a97125022c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "POST /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433091 Dec 18 03:14:03.061795 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 126/273] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:14:02 2021] POST /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:03.199245 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:03.216341 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:03.218346 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:03.221937 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c4508ea4-7a95-4f06-8b34-879f0aaab5ef tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.249516 Dec 18 03:14:03.224058 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 148/274] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:02 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:03.390411 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-aa229622-cade-4ea7-88b4-ae92727af683 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:03.391901 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-aa229622-cade-4ea7-88b4-ae92727af683 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:03.420428 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa229622-cade-4ea7-88b4-ae92727af683 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:03.421145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa229622-cade-4ea7-88b4-ae92727af683 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:03.422421 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa229622-cade-4ea7-88b4-ae92727af683 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:03.423048 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa229622-cade-4ea7-88b4-ae92727af683 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:03.604954 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-aa229622-cade-4ea7-88b4-ae92727af683 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:03.617440 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-aa229622-cade-4ea7-88b4-ae92727af683 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1498 microversion: 2.1 time: 0.232252 Dec 18 03:14:03.618057 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 127/275] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:03 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1498 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:03.779714 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-abc36783-d748-4b40-89d7-d38b8a65129b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:03.780325 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-abc36783-d748-4b40-89d7-d38b8a65129b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:03.786174 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-abc36783-d748-4b40-89d7-d38b8a65129b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:03.786623 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-abc36783-d748-4b40-89d7-d38b8a65129b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:03.787397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-abc36783-d748-4b40-89d7-d38b8a65129b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:03.788035 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-abc36783-d748-4b40-89d7-d38b8a65129b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:03.855133 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-abc36783-d748-4b40-89d7-d38b8a65129b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:03.862593 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-abc36783-d748-4b40-89d7-d38b8a65129b tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1271 microversion: 2.1 time: 0.086889 Dec 18 03:14:03.863308 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 149/276] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:03 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:03.968801 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7eab4ace-d8c0-4289-8b46-13054f5a3a5f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:03.969693 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7eab4ace-d8c0-4289-8b46-13054f5a3a5f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:03.977730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7eab4ace-d8c0-4289-8b46-13054f5a3a5f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:03.978168 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7eab4ace-d8c0-4289-8b46-13054f5a3a5f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:03.979345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7eab4ace-d8c0-4289-8b46-13054f5a3a5f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:03.980178 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7eab4ace-d8c0-4289-8b46-13054f5a3a5f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:04.127525 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7eab4ace-d8c0-4289-8b46-13054f5a3a5f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:04.135400 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7eab4ace-d8c0-4289-8b46-13054f5a3a5f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.170305 Dec 18 03:14:04.135965 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 128/277] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:03 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:04.240536 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:04.242832 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:04.251555 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:04.251944 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:04.253094 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:04.253701 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:04.439316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:04.448452 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:04.450064 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:04.451193 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9bd37b20-b02e-4469-9719-3f3ade0e671f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.214943 Dec 18 03:14:04.451734 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 150/278] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:04 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:04.720241 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-71d975f8-962b-4e71-bdf6-60278cae6d29 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:04.720751 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-71d975f8-962b-4e71-bdf6-60278cae6d29 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:04.728686 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-71d975f8-962b-4e71-bdf6-60278cae6d29 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:04.730117 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-71d975f8-962b-4e71-bdf6-60278cae6d29 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:04.731539 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-71d975f8-962b-4e71-bdf6-60278cae6d29 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:04.732309 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-71d975f8-962b-4e71-bdf6-60278cae6d29 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:04.760075 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-71d975f8-962b-4e71-bdf6-60278cae6d29 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Going to try to terminate instance {{(pid=116000) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:14:04.859467 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-71d975f8-962b-4e71-bdf6-60278cae6d29 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 204 len: 0 microversion: 2.1 time: 0.143461 Dec 18 03:14:04.862725 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 129/279] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:14:04 2021] DELETE /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:14:04.872248 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1722a45c-6544-418f-8856-8222fd611ab3 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:04.872980 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1722a45c-6544-418f-8856-8222fd611ab3 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:04.883891 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1722a45c-6544-418f-8856-8222fd611ab3 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:04.885138 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1722a45c-6544-418f-8856-8222fd611ab3 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:04.888681 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1722a45c-6544-418f-8856-8222fd611ab3 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:04.889356 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1722a45c-6544-418f-8856-8222fd611ab3 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:04.891874 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-68a0341e-c6ca-4eef-a230-65ef6a086c76 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:04.895792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-68a0341e-c6ca-4eef-a230-65ef6a086c76 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:04.916902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-68a0341e-c6ca-4eef-a230-65ef6a086c76 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:04.917386 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-68a0341e-c6ca-4eef-a230-65ef6a086c76 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:04.918217 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-68a0341e-c6ca-4eef-a230-65ef6a086c76 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:04.918855 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-68a0341e-c6ca-4eef-a230-65ef6a086c76 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:05.006660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-68a0341e-c6ca-4eef-a230-65ef6a086c76 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:05.015234 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-68a0341e-c6ca-4eef-a230-65ef6a086c76 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1277 microversion: 2.1 time: 0.134826 Dec 18 03:14:05.015805 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 130/280] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:04 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:05.072234 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1722a45c-6544-418f-8856-8222fd611ab3 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:05.081506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1722a45c-6544-418f-8856-8222fd611ab3 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1504 microversion: 2.1 time: 0.212865 Dec 18 03:14:05.084792 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 151/281] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:04 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:05.152474 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-386e608e-886a-44a3-affa-9028e8220c9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:05.153092 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-386e608e-886a-44a3-affa-9028e8220c9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:05.165745 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-386e608e-886a-44a3-affa-9028e8220c9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:05.166199 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-386e608e-886a-44a3-affa-9028e8220c9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:05.167145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-386e608e-886a-44a3-affa-9028e8220c9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:05.167695 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-386e608e-886a-44a3-affa-9028e8220c9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:05.447173 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-386e608e-886a-44a3-affa-9028e8220c9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:05.454726 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-386e608e-886a-44a3-affa-9028e8220c9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.306790 Dec 18 03:14:05.465422 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 131/282] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:05 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:05.479324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:05.479324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:05.479324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:05.479324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:05.480264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:05.480264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:05.629472 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:05.638699 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:05.640713 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:05.643546 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-105e80e8-b8a9-44c7-9845-e3c4778ee475 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.175755 Dec 18 03:14:05.653595 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 152/283] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:05 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:05.889980 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-a5eb170a-2006-438e-82cc-3fc999dd8dc7 req-af5f2597-808a-4569-9fc7-76d59422bd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57492c3-936b-4bd6-a228-ea2828faae96", "tag": "4f8c374e-f41c-48e6-9acf-025bf9c609dc"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:05.893204 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:05.893204 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:14:05.902662 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-a5eb170a-2006-438e-82cc-3fc999dd8dc7 req-af5f2597-808a-4569-9fc7-76d59422bd69 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:05.903357 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-a5eb170a-2006-438e-82cc-3fc999dd8dc7 req-af5f2597-808a-4569-9fc7-76d59422bd69 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:05.923395 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-a5eb170a-2006-438e-82cc-3fc999dd8dc7 req-af5f2597-808a-4569-9fc7-76d59422bd69 service nova] Creating event network-changed:4f8c374e-f41c-48e6-9acf-025bf9c609dc for instance c57492c3-936b-4bd6-a228-ea2828faae96 on hv-cinder-81803 Dec 18 03:14:05.928185 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-a5eb170a-2006-438e-82cc-3fc999dd8dc7 req-af5f2597-808a-4569-9fc7-76d59422bd69 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042403 Dec 18 03:14:05.929002 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 132/284] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:06.033265 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6197f396-b0c7-4301-9017-1bb8e2c18d32 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:06.033947 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6197f396-b0c7-4301-9017-1bb8e2c18d32 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:06.040432 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6197f396-b0c7-4301-9017-1bb8e2c18d32 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:06.040875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6197f396-b0c7-4301-9017-1bb8e2c18d32 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:06.041669 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6197f396-b0c7-4301-9017-1bb8e2c18d32 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:06.042096 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6197f396-b0c7-4301-9017-1bb8e2c18d32 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:06.102730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-df4410d0-f30e-4247-80a9-db46ae2300cf tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:06.103795 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-df4410d0-f30e-4247-80a9-db46ae2300cf tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:06.110351 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df4410d0-f30e-4247-80a9-db46ae2300cf tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:06.110925 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df4410d0-f30e-4247-80a9-db46ae2300cf tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:06.112106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df4410d0-f30e-4247-80a9-db46ae2300cf tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:06.112755 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df4410d0-f30e-4247-80a9-db46ae2300cf tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:06.198775 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6197f396-b0c7-4301-9017-1bb8e2c18d32 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:06.206883 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6197f396-b0c7-4301-9017-1bb8e2c18d32 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.177078 Dec 18 03:14:06.207583 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 153/285] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:06 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:06.332416 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-df4410d0-f30e-4247-80a9-db46ae2300cf tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:06.345640 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-df4410d0-f30e-4247-80a9-db46ae2300cf tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1504 microversion: 2.1 time: 0.247897 Dec 18 03:14:06.346428 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 133/286] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:06 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:06.473864 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-006bf331-ca7a-4ca6-b06d-a11ef0f6fdee tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:06.474925 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-006bf331-ca7a-4ca6-b06d-a11ef0f6fdee tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:06.484873 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-006bf331-ca7a-4ca6-b06d-a11ef0f6fdee tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:06.486080 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-006bf331-ca7a-4ca6-b06d-a11ef0f6fdee tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:06.486883 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-006bf331-ca7a-4ca6-b06d-a11ef0f6fdee tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:06.487477 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-006bf331-ca7a-4ca6-b06d-a11ef0f6fdee tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:06.663135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:06.664429 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:06.670466 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:06.671341 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:06.672212 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:06.672721 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:06.703926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-006bf331-ca7a-4ca6-b06d-a11ef0f6fdee tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:06.722085 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-006bf331-ca7a-4ca6-b06d-a11ef0f6fdee tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.253169 Dec 18 03:14:06.722682 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 154/287] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:06 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:06.849642 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:06.851374 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:06.853194 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:06.854594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1ad03328-ee2e-47df-b57e-f3620be713bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.195123 Dec 18 03:14:06.855936 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 134/288] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:06 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:14:07.224198 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d2b1ffa3-84ca-49c8-b6a6-73fcee49e877 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:07.224805 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d2b1ffa3-84ca-49c8-b6a6-73fcee49e877 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:07.230950 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d2b1ffa3-84ca-49c8-b6a6-73fcee49e877 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:07.232408 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d2b1ffa3-84ca-49c8-b6a6-73fcee49e877 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:07.233371 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d2b1ffa3-84ca-49c8-b6a6-73fcee49e877 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:07.233984 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d2b1ffa3-84ca-49c8-b6a6-73fcee49e877 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:07.364691 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2b7465ea-acd4-4366-8cf1-4bd1a5c1d2e7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:07.366723 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2b7465ea-acd4-4366-8cf1-4bd1a5c1d2e7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:07.373786 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b7465ea-acd4-4366-8cf1-4bd1a5c1d2e7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:07.374392 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b7465ea-acd4-4366-8cf1-4bd1a5c1d2e7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:07.375311 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b7465ea-acd4-4366-8cf1-4bd1a5c1d2e7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:07.375902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b7465ea-acd4-4366-8cf1-4bd1a5c1d2e7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:07.497264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d2b1ffa3-84ca-49c8-b6a6-73fcee49e877 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:07.506238 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d2b1ffa3-84ca-49c8-b6a6-73fcee49e877 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.285847 Dec 18 03:14:07.507460 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 155/289] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:07 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:07.616946 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2b7465ea-acd4-4366-8cf1-4bd1a5c1d2e7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:07.629271 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2b7465ea-acd4-4366-8cf1-4bd1a5c1d2e7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 200 len: 1504 microversion: 2.1 time: 0.268274 Dec 18 03:14:07.630889 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 135/290] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:07 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:07.739019 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e0a7e6b0-6773-4885-9fd2-9887021ded0a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:07.739723 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e0a7e6b0-6773-4885-9fd2-9887021ded0a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:07.746955 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e0a7e6b0-6773-4885-9fd2-9887021ded0a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:07.747408 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e0a7e6b0-6773-4885-9fd2-9887021ded0a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:07.748269 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e0a7e6b0-6773-4885-9fd2-9887021ded0a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:07.748761 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e0a7e6b0-6773-4885-9fd2-9887021ded0a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:07.749454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-bfc26ee6-79f0-4286-903c-8e02c950d97b req-2d722bc8-d0c8-4a26-bb03-77d88aa998da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcb36a5-8f79-4d98-8876-72a931e154f7", "name": "network-vif-deleted", "tag": "1a6e233c-6788-4906-960d-31eabd79a5f3"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:07.751887 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:07.751887 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:14:07.761050 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-bfc26ee6-79f0-4286-903c-8e02c950d97b req-2d722bc8-d0c8-4a26-bb03-77d88aa998da service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:07.761885 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-bfc26ee6-79f0-4286-903c-8e02c950d97b req-2d722bc8-d0c8-4a26-bb03-77d88aa998da service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:07.776975 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-bfc26ee6-79f0-4286-903c-8e02c950d97b req-2d722bc8-d0c8-4a26-bb03-77d88aa998da service nova] Creating event network-vif-deleted:1a6e233c-6788-4906-960d-31eabd79a5f3 for instance 1dcb36a5-8f79-4d98-8876-72a931e154f7 on hv-cinder-81803 Dec 18 03:14:07.783410 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-bfc26ee6-79f0-4286-903c-8e02c950d97b req-2d722bc8-d0c8-4a26-bb03-77d88aa998da service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037577 Dec 18 03:14:07.784234 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 136/291] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:14:07.875966 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:07.877644 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:07.885815 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:07.886565 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:07.887771 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:07.888294 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:07.917606 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e0a7e6b0-6773-4885-9fd2-9887021ded0a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:07.927103 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e0a7e6b0-6773-4885-9fd2-9887021ded0a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.191112 Dec 18 03:14:07.930244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 156/292] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:07 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:08.048151 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:08.056823 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:08.058347 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:08.059497 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3acc8681-eb04-4de7-a3d9-7998e9b289b5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.189228 Dec 18 03:14:08.060053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 137/293] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:07 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:14:08.524897 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c2209bd9-9435-4536-a7da-73bbdbef23cc tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:08.525489 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c2209bd9-9435-4536-a7da-73bbdbef23cc tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:08.535993 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2209bd9-9435-4536-a7da-73bbdbef23cc tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:08.536418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2209bd9-9435-4536-a7da-73bbdbef23cc tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:08.537425 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2209bd9-9435-4536-a7da-73bbdbef23cc tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:08.537923 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c2209bd9-9435-4536-a7da-73bbdbef23cc tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:08.647049 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e014a8dd-3d44-45cc-a3ec-21210f9e7fe8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:08.648473 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e014a8dd-3d44-45cc-a3ec-21210f9e7fe8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 1dcb36a5-8f79-4d98-8876-72a931e154f7] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:08.655970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e014a8dd-3d44-45cc-a3ec-21210f9e7fe8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:08.657673 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e014a8dd-3d44-45cc-a3ec-21210f9e7fe8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:08.657673 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e014a8dd-3d44-45cc-a3ec-21210f9e7fe8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:08.657876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e014a8dd-3d44-45cc-a3ec-21210f9e7fe8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:08.677612 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-e014a8dd-3d44-45cc-a3ec-21210f9e7fe8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] HTTP exception thrown: Instance 1dcb36a5-8f79-4d98-8876-72a931e154f7 could not be found. Dec 18 03:14:08.678463 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e014a8dd-3d44-45cc-a3ec-21210f9e7fe8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Returning 404 to user: Instance 1dcb36a5-8f79-4d98-8876-72a931e154f7 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:14:08.679445 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e014a8dd-3d44-45cc-a3ec-21210f9e7fe8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7" status: 404 len: 111 microversion: 2.1 time: 0.036044 Dec 18 03:14:08.680172 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 138/294] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:08 2021] GET /compute/v2.1/servers/1dcb36a5-8f79-4d98-8876-72a931e154f7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 03:14:08.704000 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c2209bd9-9435-4536-a7da-73bbdbef23cc tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:08.719727 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c2209bd9-9435-4536-a7da-73bbdbef23cc tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.198484 Dec 18 03:14:08.720503 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 157/295] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:08 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:08.788799 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-599082428", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "networks": [{"uuid": "56ac0911-7660-4a3b-957e-b00bd8c0a253"}]}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:08.848008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] validate_networks() for [('56ac0911-7660-4a3b-957e-b00bd8c0a253', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:14:08.944980 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3c765dfd-477f-4d7a-8073-ad3a07982cb5 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:08.946583 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3c765dfd-477f-4d7a-8073-ad3a07982cb5 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:08.952511 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c765dfd-477f-4d7a-8073-ad3a07982cb5 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:08.952958 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c765dfd-477f-4d7a-8073-ad3a07982cb5 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:08.953861 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c765dfd-477f-4d7a-8073-ad3a07982cb5 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:08.954397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c765dfd-477f-4d7a-8073-ad3a07982cb5 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:09.096193 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3c765dfd-477f-4d7a-8073-ad3a07982cb5 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:09.104454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3c765dfd-477f-4d7a-8073-ad3a07982cb5 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.164029 Dec 18 03:14:09.105282 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 158/296] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:08 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:09.118189 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:09.118816 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:09.124922 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:09.125368 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:09.126225 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:09.126657 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:09.346648 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:09.354685 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:09.356533 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:09.358513 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5d93b3ca-93e6-4b97-b625-1b2e8eaa5c3e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.243181 Dec 18 03:14:09.370883 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 159/297] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:09 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:09.378128 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:14:09.378643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:14:09.379230 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:14:09.379719 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:14:09.380210 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:14:09.390006 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:09.390449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:09.391256 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:09.391686 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:09.409201 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Getting quotas for project 720269d188094f32978b00a4858a2da0. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:14:09.413345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Getting quotas for user 5bb75fbada72413da5ed9a1b24f1ed6d and project 720269d188094f32978b00a4858a2da0. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:14:09.424579 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:14:09.427154 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:14:09.474672 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-33d4e82d-8f7d-4b73-88c8-45f9d4aed203 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689744 Dec 18 03:14:09.480146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 139/298] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:14:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:14:09.487027 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-77d67b11-bc48-48ee-9c05-7944e9448cb0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:09.488515 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-77d67b11-bc48-48ee-9c05-7944e9448cb0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:09.559895 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-77d67b11-bc48-48ee-9c05-7944e9448cb0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:09.568277 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-77d67b11-bc48-48ee-9c05-7944e9448cb0 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1213 microversion: 2.1 time: 0.086044 Dec 18 03:14:09.568818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 160/299] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:09 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:09.739567 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-30d5489a-1e54-4cb7-bfb5-5c90f3aeb513 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:09.740884 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-30d5489a-1e54-4cb7-bfb5-5c90f3aeb513 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:09.748141 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-30d5489a-1e54-4cb7-bfb5-5c90f3aeb513 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:09.748888 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-30d5489a-1e54-4cb7-bfb5-5c90f3aeb513 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:09.749923 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-30d5489a-1e54-4cb7-bfb5-5c90f3aeb513 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:09.750624 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-30d5489a-1e54-4cb7-bfb5-5c90f3aeb513 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:09.929858 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-30d5489a-1e54-4cb7-bfb5-5c90f3aeb513 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:09.939880 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-30d5489a-1e54-4cb7-bfb5-5c90f3aeb513 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.203839 Dec 18 03:14:09.940794 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 140/300] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:09 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:10.121889 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-770fc9b6-420f-49ba-8a5d-682ca66e1b02 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:10.122894 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-770fc9b6-420f-49ba-8a5d-682ca66e1b02 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:10.129717 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-770fc9b6-420f-49ba-8a5d-682ca66e1b02 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:10.130266 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-770fc9b6-420f-49ba-8a5d-682ca66e1b02 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:10.131294 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-770fc9b6-420f-49ba-8a5d-682ca66e1b02 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:10.132891 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-770fc9b6-420f-49ba-8a5d-682ca66e1b02 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:10.379687 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:10.380598 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:10.388107 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:10.389036 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:10.390014 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:10.390676 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:10.547513 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-770fc9b6-420f-49ba-8a5d-682ca66e1b02 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:10.558202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:10.568169 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-770fc9b6-420f-49ba-8a5d-682ca66e1b02 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.449172 Dec 18 03:14:10.568675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:10.569957 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 161/301] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:10 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:10.571463 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:10.572701 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4ea53ac9-57da-4cf5-88d3-0a00d9fcb45d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1745 microversion: 2.20 time: 0.197719 Dec 18 03:14:10.582709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 141/302] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:10 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:10.589674 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2376f972-1bd3-4806-9875-1c422926a99b tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:10.590300 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2376f972-1bd3-4806-9875-1c422926a99b tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:10.596246 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2376f972-1bd3-4806-9875-1c422926a99b tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:10.596697 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2376f972-1bd3-4806-9875-1c422926a99b tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:10.597483 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2376f972-1bd3-4806-9875-1c422926a99b tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:10.597956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2376f972-1bd3-4806-9875-1c422926a99b tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:10.696014 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2376f972-1bd3-4806-9875-1c422926a99b tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:10.717655 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2376f972-1bd3-4806-9875-1c422926a99b tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1265 microversion: 2.1 time: 0.132355 Dec 18 03:14:10.718516 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 162/303] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:10 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:10.959509 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4d980356-0da3-4726-921c-16e991cb2c3a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:10.961549 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4d980356-0da3-4726-921c-16e991cb2c3a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:10.972269 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d980356-0da3-4726-921c-16e991cb2c3a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:10.974385 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d980356-0da3-4726-921c-16e991cb2c3a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:10.976280 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d980356-0da3-4726-921c-16e991cb2c3a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:10.977071 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d980356-0da3-4726-921c-16e991cb2c3a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:11.166282 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4d980356-0da3-4726-921c-16e991cb2c3a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:11.179559 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4d980356-0da3-4726-921c-16e991cb2c3a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.224528 Dec 18 03:14:11.180147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 142/304] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:10 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:11.593643 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-99c9cb05-0bfd-4f03-8d3c-9524a4d12e0c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:11.594514 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:11.595298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:11.596071 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-99c9cb05-0bfd-4f03-8d3c-9524a4d12e0c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:11.606350 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-99c9cb05-0bfd-4f03-8d3c-9524a4d12e0c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:11.609335 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:11.609913 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:11.610797 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:11.611426 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-99c9cb05-0bfd-4f03-8d3c-9524a4d12e0c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:11.612370 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-99c9cb05-0bfd-4f03-8d3c-9524a4d12e0c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:11.612994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:11.618716 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-99c9cb05-0bfd-4f03-8d3c-9524a4d12e0c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:11.905583 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:11.916747 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:11.918622 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:11.926850 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b7b32f94-1087-4094-a281-cb43602f67bd tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1745 microversion: 2.20 time: 0.339180 Dec 18 03:14:11.927585 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 143/305] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:11 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1745 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:11.941977 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-95be76f8-192b-4f25-851f-ddfb2e8f0425 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:11.942938 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-95be76f8-192b-4f25-851f-ddfb2e8f0425 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:11.951602 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-95be76f8-192b-4f25-851f-ddfb2e8f0425 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:11.952342 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-95be76f8-192b-4f25-851f-ddfb2e8f0425 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:11.952848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-95be76f8-192b-4f25-851f-ddfb2e8f0425 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:11.953284 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-95be76f8-192b-4f25-851f-ddfb2e8f0425 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.013680 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-99c9cb05-0bfd-4f03-8d3c-9524a4d12e0c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:12.023427 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-99c9cb05-0bfd-4f03-8d3c-9524a4d12e0c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.441423 Dec 18 03:14:12.025942 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 163/306] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:11 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:12.033441 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-63fe62a5-aed7-465a-8a71-1dd044fedf65 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a1a6ed9-c3b2-4b17-a5cd-b0b9b67c65d2"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:12.041660 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-63fe62a5-aed7-465a-8a71-1dd044fedf65 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:12.042352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-95be76f8-192b-4f25-851f-ddfb2e8f0425 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:12.051214 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-95be76f8-192b-4f25-851f-ddfb2e8f0425 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1271 microversion: 2.1 time: 0.121371 Dec 18 03:14:12.052410 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 144/307] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:11 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:12.056570 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-63fe62a5-aed7-465a-8a71-1dd044fedf65 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.057018 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-63fe62a5-aed7-465a-8a71-1dd044fedf65 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.057833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-63fe62a5-aed7-465a-8a71-1dd044fedf65 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.058265 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-63fe62a5-aed7-465a-8a71-1dd044fedf65 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.170001 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-63fe62a5-aed7-465a-8a71-1dd044fedf65 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] HTTP exception thrown: Invalid volume: volume 8a1a6ed9-c3b2-4b17-a5cd-b0b9b67c65d2 is already attached to instances: 42694b52-21ac-48ab-9fbb-de90c7bcb478 Dec 18 03:14:12.170795 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-63fe62a5-aed7-465a-8a71-1dd044fedf65 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Returning 400 to user: Invalid volume: volume 8a1a6ed9-c3b2-4b17-a5cd-b0b9b67c65d2 is already attached to instances: 42694b52-21ac-48ab-9fbb-de90c7bcb478 {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:14:12.171864 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-63fe62a5-aed7-465a-8a71-1dd044fedf65 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "POST /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142095 Dec 18 03:14:12.172624 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 164/308] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:14:12 2021] POST /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:14:12.197129 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cc12bb08-e361-49a1-9ca4-3cfc1bc2f233 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:12.197813 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cc12bb08-e361-49a1-9ca4-3cfc1bc2f233 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:12.206667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc12bb08-e361-49a1-9ca4-3cfc1bc2f233 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.206842 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc12bb08-e361-49a1-9ca4-3cfc1bc2f233 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.211962 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc12bb08-e361-49a1-9ca4-3cfc1bc2f233 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.212408 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc12bb08-e361-49a1-9ca4-3cfc1bc2f233 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.276466 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-438cd511-7d34-479c-a38a-d58e7f1eed1b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:12.276962 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-438cd511-7d34-479c-a38a-d58e7f1eed1b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:12.290548 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-438cd511-7d34-479c-a38a-d58e7f1eed1b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.292536 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-438cd511-7d34-479c-a38a-d58e7f1eed1b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.297014 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-438cd511-7d34-479c-a38a-d58e7f1eed1b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.297534 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-438cd511-7d34-479c-a38a-d58e7f1eed1b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.394790 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-cc12bb08-e361-49a1-9ca4-3cfc1bc2f233 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:12.422146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cc12bb08-e361-49a1-9ca4-3cfc1bc2f233 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.229126 Dec 18 03:14:12.423677 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 145/309] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:12 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:12.583090 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-438cd511-7d34-479c-a38a-d58e7f1eed1b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lazy-loading 'services' on Instance uuid 42694b52-21ac-48ab-9fbb-de90c7bcb478 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:14:12.874188 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-438cd511-7d34-479c-a38a-d58e7f1eed1b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "DELETE /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments/8a1a6ed9-c3b2-4b17-a5cd-b0b9b67c65d2" status: 202 len: 0 microversion: 2.1 time: 0.601798 Dec 18 03:14:12.877095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 165/310] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:14:12 2021] DELETE /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments/8a1a6ed9-c3b2-4b17-a5cd-b0b9b67c65d2 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:14:12.886211 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-832b7066-da24-407d-bcaf-96e984bf6b75 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:12.887272 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-832b7066-da24-407d-bcaf-96e984bf6b75 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:12.896914 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-832b7066-da24-407d-bcaf-96e984bf6b75 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.897522 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-832b7066-da24-407d-bcaf-96e984bf6b75 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.910641 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-832b7066-da24-407d-bcaf-96e984bf6b75 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.912477 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-832b7066-da24-407d-bcaf-96e984bf6b75 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.947826 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:12.948829 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:12.956513 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.957199 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.958177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:12.958763 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:12.996936 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-832b7066-da24-407d-bcaf-96e984bf6b75 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115277 Dec 18 03:14:13.004268 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 146/311] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:14:12 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:14:13.043831 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d2959b74-6463-43a1-9d3b-bfa7e1ef026d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:13.046019 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d2959b74-6463-43a1-9d3b-bfa7e1ef026d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:13.062503 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d2959b74-6463-43a1-9d3b-bfa7e1ef026d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:13.063440 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d2959b74-6463-43a1-9d3b-bfa7e1ef026d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:13.064449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d2959b74-6463-43a1-9d3b-bfa7e1ef026d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:13.065050 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d2959b74-6463-43a1-9d3b-bfa7e1ef026d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:13.244775 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d2959b74-6463-43a1-9d3b-bfa7e1ef026d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:13.252812 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d2959b74-6463-43a1-9d3b-bfa7e1ef026d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.214460 Dec 18 03:14:13.256158 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 147/312] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:13 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:13.264312 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6cfebb01-7801-4f5e-9803-9e65f16f267c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:13.268692 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6cfebb01-7801-4f5e-9803-9e65f16f267c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:13.292276 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6cfebb01-7801-4f5e-9803-9e65f16f267c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:13.293051 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6cfebb01-7801-4f5e-9803-9e65f16f267c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:13.294734 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6cfebb01-7801-4f5e-9803-9e65f16f267c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:13.296106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6cfebb01-7801-4f5e-9803-9e65f16f267c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:13.531361 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-6cfebb01-7801-4f5e-9803-9e65f16f267c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:13.541133 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6cfebb01-7801-4f5e-9803-9e65f16f267c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.280209 Dec 18 03:14:13.550610 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 148/313] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:13 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:13.556675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4930989e-ceab-4cd5-94d5-4e4814ffb37a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:13.557495 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4930989e-ceab-4cd5-94d5-4e4814ffb37a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:13.563520 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4930989e-ceab-4cd5-94d5-4e4814ffb37a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:13.564149 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4930989e-ceab-4cd5-94d5-4e4814ffb37a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:13.565084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4930989e-ceab-4cd5-94d5-4e4814ffb37a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:13.565704 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4930989e-ceab-4cd5-94d5-4e4814ffb37a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:13.646208 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:13.658892 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:13.660565 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:13.664914 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5eb06784-acef-4616-b0e7-6de885c86349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.722766 Dec 18 03:14:13.673289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 166/314] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:12 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:13.821285 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4930989e-ceab-4cd5-94d5-4e4814ffb37a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:13.836601 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4930989e-ceab-4cd5-94d5-4e4814ffb37a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.284407 Dec 18 03:14:13.838582 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 149/315] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:13 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:14.012240 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ad139a77-3db2-4ad1-93ca-82ab9eda4c2c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:14.013924 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ad139a77-3db2-4ad1-93ca-82ab9eda4c2c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:14.024547 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad139a77-3db2-4ad1-93ca-82ab9eda4c2c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:14.025327 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad139a77-3db2-4ad1-93ca-82ab9eda4c2c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:14.026392 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad139a77-3db2-4ad1-93ca-82ab9eda4c2c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:14.027096 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad139a77-3db2-4ad1-93ca-82ab9eda4c2c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:14.085310 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ad139a77-3db2-4ad1-93ca-82ab9eda4c2c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077238 Dec 18 03:14:14.091852 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 167/316] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:14:14 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:14:14.272300 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9012919e-a923-4a05-abe9-3dc96f17e8bf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:14.273838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9012919e-a923-4a05-abe9-3dc96f17e8bf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:14.280106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9012919e-a923-4a05-abe9-3dc96f17e8bf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:14.289999 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9012919e-a923-4a05-abe9-3dc96f17e8bf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:14.291173 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9012919e-a923-4a05-abe9-3dc96f17e8bf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:14.293274 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9012919e-a923-4a05-abe9-3dc96f17e8bf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:14.371010 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1525111519", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "networks": [{"uuid": "1d8dfc79-d3fb-4837-9660-6625a84f5064"}]}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:14.484783 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] validate_networks() for [('1d8dfc79-d3fb-4837-9660-6625a84f5064', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:14:14.531207 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9012919e-a923-4a05-abe9-3dc96f17e8bf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:14.542241 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9012919e-a923-4a05-abe9-3dc96f17e8bf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.272146 Dec 18 03:14:14.552797 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 150/317] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:14 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:14.578631 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-7ce7ffeb-8655-4113-8f6e-8c80063fa85e req-c455cc8f-c3b4-4cdc-a76b-684f2f8bad6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa82caa-8340-4f50-9989-2ddbc243fb40", "name": "network-vif-plugged", "status": "completed", "tag": "b9de074c-64ba-4630-b439-f53e09e04d4b"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:14.580900 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:14.580900 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:14:14.592151 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-7ce7ffeb-8655-4113-8f6e-8c80063fa85e req-c455cc8f-c3b4-4cdc-a76b-684f2f8bad6b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:14.593887 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-7ce7ffeb-8655-4113-8f6e-8c80063fa85e req-c455cc8f-c3b4-4cdc-a76b-684f2f8bad6b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:14.611409 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-7ce7ffeb-8655-4113-8f6e-8c80063fa85e req-c455cc8f-c3b4-4cdc-a76b-684f2f8bad6b service nova] Creating event network-vif-plugged:b9de074c-64ba-4630-b439-f53e09e04d4b for instance aaa82caa-8340-4f50-9989-2ddbc243fb40 on hv-cinder-81803 Dec 18 03:14:14.618132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-7ce7ffeb-8655-4113-8f6e-8c80063fa85e req-c455cc8f-c3b4-4cdc-a76b-684f2f8bad6b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050320 Dec 18 03:14:14.619406 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 151/318] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:14.630207 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0c58c704-19d8-499c-b1c6-ee2bb33da100 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:14.631219 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0c58c704-19d8-499c-b1c6-ee2bb33da100 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:14.640439 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0c58c704-19d8-499c-b1c6-ee2bb33da100 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:14.641191 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0c58c704-19d8-499c-b1c6-ee2bb33da100 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:14.642236 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0c58c704-19d8-499c-b1c6-ee2bb33da100 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:14.643709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0c58c704-19d8-499c-b1c6-ee2bb33da100 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:14.898521 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0c58c704-19d8-499c-b1c6-ee2bb33da100 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:14.927910 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0c58c704-19d8-499c-b1c6-ee2bb33da100 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.306897 Dec 18 03:14:14.929500 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 152/319] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:14 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:14.944869 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:14.945598 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:14.952791 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:14.953984 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:14.961892 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:14.962343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:15.207469 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:15.217006 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:15.218520 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:15.219806 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-225f53bb-144a-4478-b8a4-52ed8f891fe8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.288749 Dec 18 03:14:15.220352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 153/320] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:14 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:15.224948 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4d444501-a3bd-4670-a064-301608942938 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:15.226214 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4d444501-a3bd-4670-a064-301608942938 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:15.233349 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d444501-a3bd-4670-a064-301608942938 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:15.233891 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d444501-a3bd-4670-a064-301608942938 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:15.234771 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d444501-a3bd-4670-a064-301608942938 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:15.235204 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d444501-a3bd-4670-a064-301608942938 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:15.365303 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:14:15.365872 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:14:15.366442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:14:15.366967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:14:15.367475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:14:15.378907 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:15.380371 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:15.381479 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:15.382185 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:15.411175 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Getting quotas for project e04a810a1bed41eb90634777ccbde0f4. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:14:15.417362 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Getting quotas for user 208a33c69dc44f399bac2a34bc018ef1 and project e04a810a1bed41eb90634777ccbde0f4. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:14:15.448648 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:14:15.452177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:14:15.525203 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4d444501-a3bd-4670-a064-301608942938 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:15.535323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4d444501-a3bd-4670-a064-301608942938 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.313555 Dec 18 03:14:15.535910 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 154/321] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:15 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:15.538289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e1b234e1-360e-4704-b601-2399f54685c0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.172008 Dec 18 03:14:15.543977 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 168/322] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:14:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:14:15.575356 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bb33786e-33cf-446f-8230-9910f0b41671 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:15.575356 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bb33786e-33cf-446f-8230-9910f0b41671 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:15.579739 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d9e16040-714e-45c6-a3b8-ee50016e5f77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:15.580001 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d9e16040-714e-45c6-a3b8-ee50016e5f77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:15.583395 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb33786e-33cf-446f-8230-9910f0b41671 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:15.586114 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb33786e-33cf-446f-8230-9910f0b41671 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:15.588109 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb33786e-33cf-446f-8230-9910f0b41671 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:15.589300 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb33786e-33cf-446f-8230-9910f0b41671 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:15.708549 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d9e16040-714e-45c6-a3b8-ee50016e5f77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:15.718505 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d9e16040-714e-45c6-a3b8-ee50016e5f77 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1218 microversion: 2.1 time: 0.161750 Dec 18 03:14:15.731598 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 155/323] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:15 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:15.736453 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-12d09338-8ef6-4d75-8b22-2ca5b064df91 req-ac485d7e-703a-4fcc-806c-f968451e2209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d29639a-4553-421a-aa64-08117561d492", "tag": "f4969446-259d-42d4-85a3-d1fddce60b47"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:15.743613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:15.743613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:14:15.766785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-12d09338-8ef6-4d75-8b22-2ca5b064df91 req-ac485d7e-703a-4fcc-806c-f968451e2209 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:15.770229 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-12d09338-8ef6-4d75-8b22-2ca5b064df91 req-ac485d7e-703a-4fcc-806c-f968451e2209 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:15.784305 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-12d09338-8ef6-4d75-8b22-2ca5b064df91 req-ac485d7e-703a-4fcc-806c-f968451e2209 service nova] Creating event network-changed:f4969446-259d-42d4-85a3-d1fddce60b47 for instance 0d29639a-4553-421a-aa64-08117561d492 on hv-cinder-81803 Dec 18 03:14:15.799345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-12d09338-8ef6-4d75-8b22-2ca5b064df91 req-ac485d7e-703a-4fcc-806c-f968451e2209 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066303 Dec 18 03:14:15.805578 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 156/324] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:15.944942 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9b60ba90-ab7c-4731-ad3d-ace0d32c47d6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:15.951964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9b60ba90-ab7c-4731-ad3d-ace0d32c47d6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:15.973172 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9b60ba90-ab7c-4731-ad3d-ace0d32c47d6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:15.973971 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9b60ba90-ab7c-4731-ad3d-ace0d32c47d6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:15.974931 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9b60ba90-ab7c-4731-ad3d-ace0d32c47d6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:15.976699 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9b60ba90-ab7c-4731-ad3d-ace0d32c47d6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:16.338702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9b60ba90-ab7c-4731-ad3d-ace0d32c47d6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:16.349479 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9b60ba90-ab7c-4731-ad3d-ace0d32c47d6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.408527 Dec 18 03:14:16.354615 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 157/325] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:15 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:16.387567 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:16.400494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:16.420660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:16.421095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:16.422195 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:16.422887 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:16.719620 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bb33786e-33cf-446f-8230-9910f0b41671 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:16.729272 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bb33786e-33cf-446f-8230-9910f0b41671 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 1.173450 Dec 18 03:14:16.733092 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 169/326] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:15 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:16.750548 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1bd0de38-d636-4c97-8589-f1f0357b0460 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:16.751396 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1bd0de38-d636-4c97-8589-f1f0357b0460 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:16.763801 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1bd0de38-d636-4c97-8589-f1f0357b0460 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:16.764903 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1bd0de38-d636-4c97-8589-f1f0357b0460 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:16.766661 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1bd0de38-d636-4c97-8589-f1f0357b0460 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:16.768531 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1bd0de38-d636-4c97-8589-f1f0357b0460 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:16.784747 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:16.794313 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:16.811641 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:16.813132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d522661f-2eec-4aa2-a304-885a9b04143f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.457063 Dec 18 03:14:16.823804 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 158/327] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:16 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:16.830106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-eb470d96-c147-470f-a662-7ede63a93c8a req-9b39c4bc-be11-4036-ba9e-d8791e36ed7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57492c3-936b-4bd6-a228-ea2828faae96", "name": "network-vif-plugged", "status": "completed", "tag": "4f8c374e-f41c-48e6-9acf-025bf9c609dc"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:16.831862 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:16.831862 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:14:16.844469 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-eb470d96-c147-470f-a662-7ede63a93c8a req-9b39c4bc-be11-4036-ba9e-d8791e36ed7d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:16.846054 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-eb470d96-c147-470f-a662-7ede63a93c8a req-9b39c4bc-be11-4036-ba9e-d8791e36ed7d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:16.866750 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-eb470d96-c147-470f-a662-7ede63a93c8a req-9b39c4bc-be11-4036-ba9e-d8791e36ed7d service nova] Creating event network-vif-plugged:4f8c374e-f41c-48e6-9acf-025bf9c609dc for instance c57492c3-936b-4bd6-a228-ea2828faae96 on hv-cinder-81803 Dec 18 03:14:16.872919 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-eb470d96-c147-470f-a662-7ede63a93c8a req-9b39c4bc-be11-4036-ba9e-d8791e36ed7d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047572 Dec 18 03:14:16.877665 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 159/328] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:16.883497 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8180a3d0-5815-4954-a188-ffe51a8a66ca tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:16.884337 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8180a3d0-5815-4954-a188-ffe51a8a66ca tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:16.907375 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8180a3d0-5815-4954-a188-ffe51a8a66ca tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:16.908822 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8180a3d0-5815-4954-a188-ffe51a8a66ca tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:16.914832 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8180a3d0-5815-4954-a188-ffe51a8a66ca tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:16.915412 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8180a3d0-5815-4954-a188-ffe51a8a66ca tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:17.023417 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8180a3d0-5815-4954-a188-ffe51a8a66ca tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:17.032451 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8180a3d0-5815-4954-a188-ffe51a8a66ca tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1270 microversion: 2.1 time: 0.153283 Dec 18 03:14:17.033321 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 160/329] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:16 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:17.133305 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1bd0de38-d636-4c97-8589-f1f0357b0460 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:17.146717 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1bd0de38-d636-4c97-8589-f1f0357b0460 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.407480 Dec 18 03:14:17.157329 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 170/330] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:16 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:17.371350 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ae136315-049d-4bd1-8b7f-de5620d36060 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:17.371967 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ae136315-049d-4bd1-8b7f-de5620d36060 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:17.389119 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ae136315-049d-4bd1-8b7f-de5620d36060 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:17.390390 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ae136315-049d-4bd1-8b7f-de5620d36060 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:17.391571 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ae136315-049d-4bd1-8b7f-de5620d36060 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:17.392253 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ae136315-049d-4bd1-8b7f-de5620d36060 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:17.712137 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ae136315-049d-4bd1-8b7f-de5620d36060 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:17.720305 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ae136315-049d-4bd1-8b7f-de5620d36060 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.352565 Dec 18 03:14:17.730618 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 161/331] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:17 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:17.750813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-26c23e1d-ec49-4e19-8e1e-c379b987b1cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:17.751509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-26c23e1d-ec49-4e19-8e1e-c379b987b1cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:17.761964 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-26c23e1d-ec49-4e19-8e1e-c379b987b1cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:17.762419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-26c23e1d-ec49-4e19-8e1e-c379b987b1cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:17.763412 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-26c23e1d-ec49-4e19-8e1e-c379b987b1cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:17.764306 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-26c23e1d-ec49-4e19-8e1e-c379b987b1cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:17.836192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:17.838188 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:17.845351 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:17.846101 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:17.847082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:17.847752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:18.066955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:18.081950 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:18.083871 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:18.086343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f191c8ca-a024-429f-ac76-e3ad40d5d82a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.255155 Dec 18 03:14:18.094793 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 162/332] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:17 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:14:18.099009 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f85d658e-678e-43e2-bc6d-7fc22d81f598 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:18.102386 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f85d658e-678e-43e2-bc6d-7fc22d81f598 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:18.115373 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f85d658e-678e-43e2-bc6d-7fc22d81f598 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:18.116354 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f85d658e-678e-43e2-bc6d-7fc22d81f598 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:18.117180 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f85d658e-678e-43e2-bc6d-7fc22d81f598 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:18.119708 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f85d658e-678e-43e2-bc6d-7fc22d81f598 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:18.293384 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-26c23e1d-ec49-4e19-8e1e-c379b987b1cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:18.301170 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-26c23e1d-ec49-4e19-8e1e-c379b987b1cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1521 microversion: 2.1 time: 0.555075 Dec 18 03:14:18.308018 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f85d658e-678e-43e2-bc6d-7fc22d81f598 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:18.316239 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f85d658e-678e-43e2-bc6d-7fc22d81f598 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1278 microversion: 2.1 time: 0.221092 Dec 18 03:14:18.316526 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 171/333] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:17 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:18.317421 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 163/334] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:18 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:18.327073 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-486a2d12-892a-4a59-8a6f-f3b1dcd00c8e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:18.332874 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-486a2d12-892a-4a59-8a6f-f3b1dcd00c8e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:18.350547 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-486a2d12-892a-4a59-8a6f-f3b1dcd00c8e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:18.354664 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-486a2d12-892a-4a59-8a6f-f3b1dcd00c8e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:18.358007 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-486a2d12-892a-4a59-8a6f-f3b1dcd00c8e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:18.361883 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-486a2d12-892a-4a59-8a6f-f3b1dcd00c8e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:18.725692 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-486a2d12-892a-4a59-8a6f-f3b1dcd00c8e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:18.737438 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-486a2d12-892a-4a59-8a6f-f3b1dcd00c8e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1319 microversion: 2.1 time: 0.416364 Dec 18 03:14:18.738401 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 172/335] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:18 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:18.739671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-78d5308c-da85-4f47-8d5a-7b08d9c35266 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:18.740401 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-78d5308c-da85-4f47-8d5a-7b08d9c35266 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:18.750814 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-78d5308c-da85-4f47-8d5a-7b08d9c35266 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:18.752132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-78d5308c-da85-4f47-8d5a-7b08d9c35266 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:18.754775 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-78d5308c-da85-4f47-8d5a-7b08d9c35266 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:18.759269 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-78d5308c-da85-4f47-8d5a-7b08d9c35266 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.112050 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:19.112654 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:19.120387 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.120841 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.121656 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.122084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.361855 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-78d5308c-da85-4f47-8d5a-7b08d9c35266 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:19.371666 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-78d5308c-da85-4f47-8d5a-7b08d9c35266 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.637739 Dec 18 03:14:19.374766 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 164/336] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:18 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:19.385283 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3c1a48d0-2b97-4e51-b0b9-4fb3d7b9818e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:19.387071 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3c1a48d0-2b97-4e51-b0b9-4fb3d7b9818e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:19.400606 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c1a48d0-2b97-4e51-b0b9-4fb3d7b9818e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.401297 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c1a48d0-2b97-4e51-b0b9-4fb3d7b9818e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.402313 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c1a48d0-2b97-4e51-b0b9-4fb3d7b9818e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.402896 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c1a48d0-2b97-4e51-b0b9-4fb3d7b9818e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.562701 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:19.577459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:19.583135 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:19.589423 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0ca32999-712a-4dca-ada5-74aaadadd60f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.476035 Dec 18 03:14:19.590093 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 173/337] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:19 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:19.603926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-af8b66f0-493e-4ff0-b8d9-c5842b1c8a6b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:19.608265 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-af8b66f0-493e-4ff0-b8d9-c5842b1c8a6b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:19.624516 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-af8b66f0-493e-4ff0-b8d9-c5842b1c8a6b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.629730 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-af8b66f0-493e-4ff0-b8d9-c5842b1c8a6b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.632115 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-af8b66f0-493e-4ff0-b8d9-c5842b1c8a6b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.634693 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-af8b66f0-493e-4ff0-b8d9-c5842b1c8a6b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.847154 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3c1a48d0-2b97-4e51-b0b9-4fb3d7b9818e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:19.859143 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3c1a48d0-2b97-4e51-b0b9-4fb3d7b9818e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1501 microversion: 2.1 time: 0.482692 Dec 18 03:14:19.861770 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 165/338] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:19 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1501 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:19.873955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ba4e218a-3d25-41b0-9169-ac107d23ffce tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:19.875835 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ba4e218a-3d25-41b0-9169-ac107d23ffce tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:19.890301 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ba4e218a-3d25-41b0-9169-ac107d23ffce tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.893642 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ba4e218a-3d25-41b0-9169-ac107d23ffce tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.894550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ba4e218a-3d25-41b0-9169-ac107d23ffce tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.894992 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ba4e218a-3d25-41b0-9169-ac107d23ffce tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.942457 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-af8b66f0-493e-4ff0-b8d9-c5842b1c8a6b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:19.952177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-af8b66f0-493e-4ff0-b8d9-c5842b1c8a6b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.352624 Dec 18 03:14:19.953368 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 174/339] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:19 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:19.967847 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e7396333-0c67-421c-91d5-0ab3fbd9719b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:19.968465 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e7396333-0c67-421c-91d5-0ab3fbd9719b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:19.975715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e7396333-0c67-421c-91d5-0ab3fbd9719b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.976163 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e7396333-0c67-421c-91d5-0ab3fbd9719b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:19.976954 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e7396333-0c67-421c-91d5-0ab3fbd9719b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:19.977437 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e7396333-0c67-421c-91d5-0ab3fbd9719b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:20.187768 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e7396333-0c67-421c-91d5-0ab3fbd9719b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:20.200260 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e7396333-0c67-421c-91d5-0ab3fbd9719b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1514 microversion: 2.1 time: 0.235929 Dec 18 03:14:20.226115 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 175/340] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:19 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:20.392143 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e80d1ded-8eb3-44f3-95ed-020dc91ad9f1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:20.393079 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e80d1ded-8eb3-44f3-95ed-020dc91ad9f1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:20.424827 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e80d1ded-8eb3-44f3-95ed-020dc91ad9f1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:20.425289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e80d1ded-8eb3-44f3-95ed-020dc91ad9f1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:20.426136 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e80d1ded-8eb3-44f3-95ed-020dc91ad9f1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:20.426576 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e80d1ded-8eb3-44f3-95ed-020dc91ad9f1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:20.690244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e80d1ded-8eb3-44f3-95ed-020dc91ad9f1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:20.712330 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e80d1ded-8eb3-44f3-95ed-020dc91ad9f1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.324322 Dec 18 03:14:20.713769 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 176/341] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:20 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:20.718786 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:20.719850 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:20.730788 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:20.731614 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:20.735120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:20.735783 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:20.847281 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ba4e218a-3d25-41b0-9169-ac107d23ffce tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:20.871278 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ba4e218a-3d25-41b0-9169-ac107d23ffce tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1507 microversion: 2.1 time: 1.002676 Dec 18 03:14:20.872162 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 166/342] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:19 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1507 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:20.973744 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0234b3ec-c66d-458c-955c-46038deb5725 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:20.974526 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0234b3ec-c66d-458c-955c-46038deb5725 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:21.001979 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0234b3ec-c66d-458c-955c-46038deb5725 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:21.003314 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0234b3ec-c66d-458c-955c-46038deb5725 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:21.009868 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0234b3ec-c66d-458c-955c-46038deb5725 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:21.011631 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0234b3ec-c66d-458c-955c-46038deb5725 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:21.039653 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:21.050480 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:21.055489 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:21.058246 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2a7b95e3-dccb-4bdb-b532-ca20dba95445 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.343190 Dec 18 03:14:21.070329 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 177/343] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:20 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:21.687972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-3fd59a5a-6997-4f3c-8e29-d0374755d9ec req-b3ef68be-b3b9-4aa9-af76-f5ced10f4ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c701ed3f-302c-4f83-8e8f-1c9932a9e349", "tag": "a6d3a37f-f909-4ef5-ac88-8d8b1dc87759"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:21.691660 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:21.691660 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:14:21.714725 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0234b3ec-c66d-458c-955c-46038deb5725 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:21.723678 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0234b3ec-c66d-458c-955c-46038deb5725 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.755487 Dec 18 03:14:21.732522 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-3fd59a5a-6997-4f3c-8e29-d0374755d9ec req-b3ef68be-b3b9-4aa9-af76-f5ced10f4ff9 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:21.736793 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 167/344] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:20 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:21.751024 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-3fd59a5a-6997-4f3c-8e29-d0374755d9ec req-b3ef68be-b3b9-4aa9-af76-f5ced10f4ff9 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:21.771769 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3cb63466-edd4-44df-b8d4-95e14e2266a8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:21.772874 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3cb63466-edd4-44df-b8d4-95e14e2266a8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:21.773694 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-3fd59a5a-6997-4f3c-8e29-d0374755d9ec req-b3ef68be-b3b9-4aa9-af76-f5ced10f4ff9 service nova] Creating event network-changed:a6d3a37f-f909-4ef5-ac88-8d8b1dc87759 for instance c701ed3f-302c-4f83-8e8f-1c9932a9e349 on hv-cinder-81803 Dec 18 03:14:21.780177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-3fd59a5a-6997-4f3c-8e29-d0374755d9ec req-b3ef68be-b3b9-4aa9-af76-f5ced10f4ff9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098683 Dec 18 03:14:21.782081 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 178/345] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:14:21.793562 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cb63466-edd4-44df-b8d4-95e14e2266a8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:21.794387 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cb63466-edd4-44df-b8d4-95e14e2266a8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:21.797297 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cb63466-edd4-44df-b8d4-95e14e2266a8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:21.798044 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cb63466-edd4-44df-b8d4-95e14e2266a8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:21.834639 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f17ab160-a141-4bfd-801a-af29ee4f51ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:21.836861 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f17ab160-a141-4bfd-801a-af29ee4f51ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:21.848491 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f17ab160-a141-4bfd-801a-af29ee4f51ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:21.853251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f17ab160-a141-4bfd-801a-af29ee4f51ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:21.854425 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f17ab160-a141-4bfd-801a-af29ee4f51ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:21.855272 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f17ab160-a141-4bfd-801a-af29ee4f51ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:21.963633 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-f17ab160-a141-4bfd-801a-af29ee4f51ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lazy-loading 'flavor' on Instance uuid d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:14:22.343663 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f17ab160-a141-4bfd-801a-af29ee4f51ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/action" status: 200 len: 32 microversion: 2.1 time: 0.512781 Dec 18 03:14:22.344344 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 179/346] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:14:21 2021] POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:14:22.369018 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:22.378543 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:22.393441 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:22.407434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:22.411797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:22.413435 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:22.501110 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3cb63466-edd4-44df-b8d4-95e14e2266a8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:22.512544 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3cb63466-edd4-44df-b8d4-95e14e2266a8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.773365 Dec 18 03:14:22.540362 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 168/347] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:21 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:22.561860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0ca63768-9496-4ae1-a51f-2c4c4ccf96d8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:22.562451 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0ca63768-9496-4ae1-a51f-2c4c4ccf96d8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:22.627039 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0ca63768-9496-4ae1-a51f-2c4c4ccf96d8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:22.627864 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0ca63768-9496-4ae1-a51f-2c4c4ccf96d8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:22.628835 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0ca63768-9496-4ae1-a51f-2c4c4ccf96d8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:22.629424 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0ca63768-9496-4ae1-a51f-2c4c4ccf96d8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:23.665994 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:23.675409 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:23.676921 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:23.689125 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2b5d0504-8f3b-4334-b7bc-b5800e46e69f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 1.337927 Dec 18 03:14:23.689756 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 180/348] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:22 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:23.718762 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1a667f3c-6604-43cd-8227-8aab443854cd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:23.719290 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1a667f3c-6604-43cd-8227-8aab443854cd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:23.737708 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a667f3c-6604-43cd-8227-8aab443854cd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:23.738172 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a667f3c-6604-43cd-8227-8aab443854cd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:23.738982 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a667f3c-6604-43cd-8227-8aab443854cd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:23.739419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a667f3c-6604-43cd-8227-8aab443854cd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:23.937169 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0ca63768-9496-4ae1-a51f-2c4c4ccf96d8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:23.954696 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0ca63768-9496-4ae1-a51f-2c4c4ccf96d8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 1.406438 Dec 18 03:14:23.956645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 169/349] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:22 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:23.983601 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-88cec864-b3ed-4df1-8899-e6bd2217c6b1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:23.984503 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-88cec864-b3ed-4df1-8899-e6bd2217c6b1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:23.993845 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-88cec864-b3ed-4df1-8899-e6bd2217c6b1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:23.994612 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-88cec864-b3ed-4df1-8899-e6bd2217c6b1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:23.995594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-88cec864-b3ed-4df1-8899-e6bd2217c6b1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:23.996262 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-88cec864-b3ed-4df1-8899-e6bd2217c6b1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:24.477774 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-88cec864-b3ed-4df1-8899-e6bd2217c6b1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:24.503078 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-88cec864-b3ed-4df1-8899-e6bd2217c6b1 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.543031 Dec 18 03:14:24.505123 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 170/350] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:23 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:24.527921 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1a667f3c-6604-43cd-8227-8aab443854cd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:24.536814 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1a667f3c-6604-43cd-8227-8aab443854cd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.824862 Dec 18 03:14:24.538815 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 181/351] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:23 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:24.708225 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:24.709756 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:24.719248 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:24.719702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:24.720502 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:24.720941 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:24.972265 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a9b7105d-5415-4473-a66d-03605a22dc10 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:24.973275 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a9b7105d-5415-4473-a66d-03605a22dc10 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:24.980907 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a9b7105d-5415-4473-a66d-03605a22dc10 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:24.981356 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a9b7105d-5415-4473-a66d-03605a22dc10 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:24.982176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a9b7105d-5415-4473-a66d-03605a22dc10 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:24.982611 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a9b7105d-5415-4473-a66d-03605a22dc10 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:25.217156 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:25.232721 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:25.234265 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:25.235845 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-03335338-9a33-4422-ba0c-49298ea05b58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.531695 Dec 18 03:14:25.247995 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 171/352] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:24 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:25.260402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a9b7105d-5415-4473-a66d-03605a22dc10 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:25.270580 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a9b7105d-5415-4473-a66d-03605a22dc10 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.301905 Dec 18 03:14:25.272233 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 182/353] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:24 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:25.528447 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5199736c-b903-43cb-8133-84e2cbbc947d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:25.528974 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5199736c-b903-43cb-8133-84e2cbbc947d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:25.535305 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5199736c-b903-43cb-8133-84e2cbbc947d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:25.535751 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5199736c-b903-43cb-8133-84e2cbbc947d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:25.536536 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5199736c-b903-43cb-8133-84e2cbbc947d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:25.536970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5199736c-b903-43cb-8133-84e2cbbc947d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:25.555909 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b58a0e25-ebb4-4dc5-b72b-55d84ff7387b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:25.556527 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b58a0e25-ebb4-4dc5-b72b-55d84ff7387b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:25.571003 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b58a0e25-ebb4-4dc5-b72b-55d84ff7387b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:25.571454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b58a0e25-ebb4-4dc5-b72b-55d84ff7387b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:25.572266 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b58a0e25-ebb4-4dc5-b72b-55d84ff7387b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:25.572732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b58a0e25-ebb4-4dc5-b72b-55d84ff7387b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:25.874707 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5199736c-b903-43cb-8133-84e2cbbc947d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:25.884087 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5199736c-b903-43cb-8133-84e2cbbc947d tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.359267 Dec 18 03:14:25.887605 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 172/354] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:25 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:26.082942 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b58a0e25-ebb4-4dc5-b72b-55d84ff7387b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:26.094555 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b58a0e25-ebb4-4dc5-b72b-55d84ff7387b tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.542998 Dec 18 03:14:26.107950 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 183/355] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:25 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:26.254603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:26.255432 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:26.267466 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:26.268328 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:26.269397 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:26.270086 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:26.289941 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d84ea10d-0eaa-4992-9720-766ecf0ebf68 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:26.295341 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d84ea10d-0eaa-4992-9720-766ecf0ebf68 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:26.312657 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d84ea10d-0eaa-4992-9720-766ecf0ebf68 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:26.313133 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d84ea10d-0eaa-4992-9720-766ecf0ebf68 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:26.315439 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d84ea10d-0eaa-4992-9720-766ecf0ebf68 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:26.316136 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d84ea10d-0eaa-4992-9720-766ecf0ebf68 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:26.580146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:26.589361 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:26.591956 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:26.593247 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cb74a91b-275d-45b6-b07c-1a01f65823be tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.342337 Dec 18 03:14:26.605655 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 173/356] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:26 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:26.728158 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d84ea10d-0eaa-4992-9720-766ecf0ebf68 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:26.742090 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d84ea10d-0eaa-4992-9720-766ecf0ebf68 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.456552 Dec 18 03:14:26.742703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 184/357] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:26 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:26.910853 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fbb8cddc-3591-4c69-b4ca-da1ee43cfed6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:26.921073 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-fbb8cddc-3591-4c69-b4ca-da1ee43cfed6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:26.954843 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fbb8cddc-3591-4c69-b4ca-da1ee43cfed6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:26.961263 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fbb8cddc-3591-4c69-b4ca-da1ee43cfed6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:26.963423 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fbb8cddc-3591-4c69-b4ca-da1ee43cfed6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:26.964353 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fbb8cddc-3591-4c69-b4ca-da1ee43cfed6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:27.079060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-d5cc9f3e-8377-46bf-b739-e785ad5364ce req-1cdd6dc3-5218-45a1-b0e9-b29ce6cd23e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d29639a-4553-421a-aa64-08117561d492", "name": "network-vif-plugged", "status": "completed", "tag": "f4969446-259d-42d4-85a3-d1fddce60b47"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:27.082101 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:27.082101 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:14:27.110971 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-d5cc9f3e-8377-46bf-b739-e785ad5364ce req-1cdd6dc3-5218-45a1-b0e9-b29ce6cd23e5 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:27.122876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-d5cc9f3e-8377-46bf-b739-e785ad5364ce req-1cdd6dc3-5218-45a1-b0e9-b29ce6cd23e5 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:27.171704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-d5cc9f3e-8377-46bf-b739-e785ad5364ce req-1cdd6dc3-5218-45a1-b0e9-b29ce6cd23e5 service nova] Creating event network-vif-plugged:f4969446-259d-42d4-85a3-d1fddce60b47 for instance 0d29639a-4553-421a-aa64-08117561d492 on hv-cinder-81803 Dec 18 03:14:27.197292 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-d5cc9f3e-8377-46bf-b739-e785ad5364ce req-1cdd6dc3-5218-45a1-b0e9-b29ce6cd23e5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124656 Dec 18 03:14:27.203304 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 185/358] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:27.227692 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bdad30df-d95b-4894-a27b-6c71862cd640 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:27.230959 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bdad30df-d95b-4894-a27b-6c71862cd640 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:27.266870 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bdad30df-d95b-4894-a27b-6c71862cd640 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:27.267612 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bdad30df-d95b-4894-a27b-6c71862cd640 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:27.268942 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bdad30df-d95b-4894-a27b-6c71862cd640 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:27.269596 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bdad30df-d95b-4894-a27b-6c71862cd640 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:27.610162 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bdad30df-d95b-4894-a27b-6c71862cd640 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:27.625406 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bdad30df-d95b-4894-a27b-6c71862cd640 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.420377 Dec 18 03:14:27.628363 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 186/359] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:27 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:27.635495 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:27.636374 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:27.647100 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:27.648264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:27.649762 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:27.650349 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:27.734614 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-fbb8cddc-3591-4c69-b4ca-da1ee43cfed6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:27.743072 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-fbb8cddc-3591-4c69-b4ca-da1ee43cfed6 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 0.839037 Dec 18 03:14:27.747481 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 174/360] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:26 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:27.763873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-95cb9144-a72e-44ee-9e59-3c7c1382708f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:27.764492 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-95cb9144-a72e-44ee-9e59-3c7c1382708f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:27.778142 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-95cb9144-a72e-44ee-9e59-3c7c1382708f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:27.780330 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-95cb9144-a72e-44ee-9e59-3c7c1382708f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:27.781367 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-95cb9144-a72e-44ee-9e59-3c7c1382708f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:27.783375 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-95cb9144-a72e-44ee-9e59-3c7c1382708f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:27.898235 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:27.919062 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:27.921352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:27.932309 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c9f9b4c0-dc65-46c1-8e20-84867c98906d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.302518 Dec 18 03:14:27.933300 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 187/361] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:27 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:28.105267 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-95cb9144-a72e-44ee-9e59-3c7c1382708f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:28.112553 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-95cb9144-a72e-44ee-9e59-3c7c1382708f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.357438 Dec 18 03:14:28.113138 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 175/362] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:27 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:28.644644 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8bc3269e-cf25-4967-968a-12c11df0273e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:28.645352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8bc3269e-cf25-4967-968a-12c11df0273e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:28.657586 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8bc3269e-cf25-4967-968a-12c11df0273e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:28.658337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8bc3269e-cf25-4967-968a-12c11df0273e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:28.659871 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8bc3269e-cf25-4967-968a-12c11df0273e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:28.663500 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8bc3269e-cf25-4967-968a-12c11df0273e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:28.762719 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-447e8518-6974-4852-9916-4d2f2a016a2c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:28.763484 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-447e8518-6974-4852-9916-4d2f2a016a2c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:28.787865 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-447e8518-6974-4852-9916-4d2f2a016a2c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:28.788722 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-447e8518-6974-4852-9916-4d2f2a016a2c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:28.791034 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-447e8518-6974-4852-9916-4d2f2a016a2c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:28.794220 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-447e8518-6974-4852-9916-4d2f2a016a2c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:29.035972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8bc3269e-cf25-4967-968a-12c11df0273e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:29.045690 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8bc3269e-cf25-4967-968a-12c11df0273e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.404115 Dec 18 03:14:29.050159 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 188/363] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:28 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:29.051550 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:29.053452 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:29.061184 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:29.061959 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:29.063864 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:29.064682 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:29.332895 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:29.356231 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:29.360763 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:29.362126 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f3521b3e-a16e-406b-ac85-fe9f49929ebf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.314348 Dec 18 03:14:29.362724 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 189/364] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:29 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:29.368979 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4dd8382a-ade5-4d97-81cc-a3e77d0bf1b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:29.375056 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4dd8382a-ade5-4d97-81cc-a3e77d0bf1b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:29.384855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4dd8382a-ade5-4d97-81cc-a3e77d0bf1b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:29.385610 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4dd8382a-ade5-4d97-81cc-a3e77d0bf1b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:29.386704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4dd8382a-ade5-4d97-81cc-a3e77d0bf1b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:29.387475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4dd8382a-ade5-4d97-81cc-a3e77d0bf1b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:29.600807 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4dd8382a-ade5-4d97-81cc-a3e77d0bf1b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:29.612691 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4dd8382a-ade5-4d97-81cc-a3e77d0bf1b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.247620 Dec 18 03:14:29.617559 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 190/365] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:29 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:29.792400 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-447e8518-6974-4852-9916-4d2f2a016a2c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:29.828345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-447e8518-6974-4852-9916-4d2f2a016a2c tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1313 microversion: 2.1 time: 1.064191 Dec 18 03:14:29.829020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 176/366] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:28 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1313 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:30.066631 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-cb18392c-3213-417d-b92d-e9d8f22b6398 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:30.067443 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-cb18392c-3213-417d-b92d-e9d8f22b6398 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:30.075909 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cb18392c-3213-417d-b92d-e9d8f22b6398 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:30.076361 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cb18392c-3213-417d-b92d-e9d8f22b6398 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:30.077167 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cb18392c-3213-417d-b92d-e9d8f22b6398 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:30.077601 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cb18392c-3213-417d-b92d-e9d8f22b6398 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:30.388359 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:30.389822 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:30.419174 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-cb18392c-3213-417d-b92d-e9d8f22b6398 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:30.448872 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-cb18392c-3213-417d-b92d-e9d8f22b6398 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.386621 Dec 18 03:14:30.450977 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:30.451423 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:30.452240 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:30.452647 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:30.454923 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 191/367] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:30 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:30.638819 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-62e2fd64-8306-4b95-abe0-90f206677957 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:30.638819 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-62e2fd64-8306-4b95-abe0-90f206677957 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:30.657860 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-62e2fd64-8306-4b95-abe0-90f206677957 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:30.659658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-62e2fd64-8306-4b95-abe0-90f206677957 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:30.669887 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-62e2fd64-8306-4b95-abe0-90f206677957 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:30.670734 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-62e2fd64-8306-4b95-abe0-90f206677957 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:30.955369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:30.978927 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:30.981037 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-62e2fd64-8306-4b95-abe0-90f206677957 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:30.985698 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:30.988091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-849ef860-460b-450b-8863-e60c9499e6e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.610939 Dec 18 03:14:30.992730 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-62e2fd64-8306-4b95-abe0-90f206677957 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.362440 Dec 18 03:14:30.994186 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 192/368] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:30 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:31.001243 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2253df5d-59a5-4b18-a83c-34033ff1d3a4 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:31.002485 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2253df5d-59a5-4b18-a83c-34033ff1d3a4 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:31.013591 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2253df5d-59a5-4b18-a83c-34033ff1d3a4 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:31.015139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2253df5d-59a5-4b18-a83c-34033ff1d3a4 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:31.019458 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2253df5d-59a5-4b18-a83c-34033ff1d3a4 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:31.020677 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2253df5d-59a5-4b18-a83c-34033ff1d3a4 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:31.030218 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 177/369] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:30 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:31.244775 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2253df5d-59a5-4b18-a83c-34033ff1d3a4 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:31.276085 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2253df5d-59a5-4b18-a83c-34033ff1d3a4 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1497 microversion: 2.1 time: 0.277953 Dec 18 03:14:31.276085 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 193/370] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:30 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1497 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:31.465568 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1c273c50-9edc-4c2e-843a-da6741d5daff tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:31.466313 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1c273c50-9edc-4c2e-843a-da6741d5daff tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:31.479269 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c273c50-9edc-4c2e-843a-da6741d5daff tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:31.480509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c273c50-9edc-4c2e-843a-da6741d5daff tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:31.481761 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c273c50-9edc-4c2e-843a-da6741d5daff tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:31.482209 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c273c50-9edc-4c2e-843a-da6741d5daff tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:31.488303 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-65cf4e0b-ecf5-45f3-9e00-532aac41131c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Action: 'create', calling method: .version_select at 0x7fad2636da60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-412012440"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:31.515857 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-65cf4e0b-ecf5-45f3-9e00-532aac41131c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for project f7f34416462043419f27fc97d17ab2bb. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:14:31.521298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-65cf4e0b-ecf5-45f3-9e00-532aac41131c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for user fd2d51b351b44cdfb136d754ffdf3f0f and project f7f34416462043419f27fc97d17ab2bb. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:14:31.796150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1c273c50-9edc-4c2e-843a-da6741d5daff tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:31.812768 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1c273c50-9edc-4c2e-843a-da6741d5daff tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.350465 Dec 18 03:14:31.822383 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 194/371] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:31 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:31.870370 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-65cf4e0b-ecf5-45f3-9e00-532aac41131c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for project f7f34416462043419f27fc97d17ab2bb. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:14:31.875133 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-65cf4e0b-ecf5-45f3-9e00-532aac41131c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for user fd2d51b351b44cdfb136d754ffdf3f0f and project f7f34416462043419f27fc97d17ab2bb. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:14:31.911488 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-65cf4e0b-ecf5-45f3-9e00-532aac41131c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.674807 Dec 18 03:14:31.913356 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 178/372] 10.222.0.24 () {60 vars in 1157 bytes} [Sat Dec 18 03:14:31 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:32.013910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b4210f22-61c4-4e6a-aa3b-182246ab1f40 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:32.015061 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b4210f22-61c4-4e6a-aa3b-182246ab1f40 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:32.025342 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b4210f22-61c4-4e6a-aa3b-182246ab1f40 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.025342 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b4210f22-61c4-4e6a-aa3b-182246ab1f40 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.026192 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b4210f22-61c4-4e6a-aa3b-182246ab1f40 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.026192 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b4210f22-61c4-4e6a-aa3b-182246ab1f40 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.030683 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:32.031305 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:32.041407 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.041858 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.042659 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.043092 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.276090 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b4210f22-61c4-4e6a-aa3b-182246ab1f40 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:32.286585 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b4210f22-61c4-4e6a-aa3b-182246ab1f40 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.275856 Dec 18 03:14:32.294930 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 195/373] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:32 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:32.301737 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-667e4608-dd28-4537-b16a-ab8428d1b2ee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:32.302476 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-667e4608-dd28-4537-b16a-ab8428d1b2ee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:32.310275 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:32.311124 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-667e4608-dd28-4537-b16a-ab8428d1b2ee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.311919 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-667e4608-dd28-4537-b16a-ab8428d1b2ee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.312886 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-667e4608-dd28-4537-b16a-ab8428d1b2ee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.313479 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-667e4608-dd28-4537-b16a-ab8428d1b2ee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.322604 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:32.324083 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:32.325302 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e9b911f0-9cf9-4f66-a7e6-1933fddba1f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1740 microversion: 2.20 time: 0.298604 Dec 18 03:14:32.330298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 179/374] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:32 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:32.347291 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-667e4608-dd28-4537-b16a-ab8428d1b2ee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:14:32.455278 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-667e4608-dd28-4537-b16a-ab8428d1b2ee tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "DELETE /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 204 len: 0 microversion: 2.1 time: 0.158352 Dec 18 03:14:32.456216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 196/375] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:14:32 2021] DELETE /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:14:32.466061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-aa00f597-9b85-4536-8c37-5c021f5e9be7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:32.466679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-aa00f597-9b85-4536-8c37-5c021f5e9be7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:32.476476 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa00f597-9b85-4536-8c37-5c021f5e9be7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.480051 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa00f597-9b85-4536-8c37-5c021f5e9be7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.481174 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa00f597-9b85-4536-8c37-5c021f5e9be7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.481884 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa00f597-9b85-4536-8c37-5c021f5e9be7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.688544 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-aa00f597-9b85-4536-8c37-5c021f5e9be7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:32.701071 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-aa00f597-9b85-4536-8c37-5c021f5e9be7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1503 microversion: 2.1 time: 0.237704 Dec 18 03:14:32.712079 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 180/376] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:32 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:32.791046 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-29b988a9-240b-4e30-b5e2-fc5bb666df33 req-df434f62-1335-4537-af45-8647649f214e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c701ed3f-302c-4f83-8e8f-1c9932a9e349", "name": "network-vif-plugged", "status": "completed", "tag": "a6d3a37f-f909-4ef5-ac88-8d8b1dc87759"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:32.792835 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:32.792835 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:14:32.804991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-29b988a9-240b-4e30-b5e2-fc5bb666df33 req-df434f62-1335-4537-af45-8647649f214e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.805554 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-29b988a9-240b-4e30-b5e2-fc5bb666df33 req-df434f62-1335-4537-af45-8647649f214e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.822849 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-29b988a9-240b-4e30-b5e2-fc5bb666df33 req-df434f62-1335-4537-af45-8647649f214e service nova] Creating event network-vif-plugged:a6d3a37f-f909-4ef5-ac88-8d8b1dc87759 for instance c701ed3f-302c-4f83-8e8f-1c9932a9e349 on hv-cinder-81803 Dec 18 03:14:32.828690 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-29b988a9-240b-4e30-b5e2-fc5bb666df33 req-df434f62-1335-4537-af45-8647649f214e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042693 Dec 18 03:14:32.829658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 197/377] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:14:32.836353 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-934fdea6-bacc-456a-a467-b2c0d9581788 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:32.837206 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-934fdea6-bacc-456a-a467-b2c0d9581788 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:32.847653 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-934fdea6-bacc-456a-a467-b2c0d9581788 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.848330 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-934fdea6-bacc-456a-a467-b2c0d9581788 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:32.849824 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-934fdea6-bacc-456a-a467-b2c0d9581788 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:32.850898 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-934fdea6-bacc-456a-a467-b2c0d9581788 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:33.025481 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-934fdea6-bacc-456a-a467-b2c0d9581788 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:33.036142 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-934fdea6-bacc-456a-a467-b2c0d9581788 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.209266 Dec 18 03:14:33.037840 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 181/378] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:32 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:33.306506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9422b2f2-1b38-459e-8de5-7cbd1e6270de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:33.308110 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9422b2f2-1b38-459e-8de5-7cbd1e6270de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:33.315692 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9422b2f2-1b38-459e-8de5-7cbd1e6270de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:33.316506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9422b2f2-1b38-459e-8de5-7cbd1e6270de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:33.317597 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9422b2f2-1b38-459e-8de5-7cbd1e6270de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:33.318440 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9422b2f2-1b38-459e-8de5-7cbd1e6270de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:33.344847 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:33.345545 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:33.356744 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:33.359770 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:33.362059 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:33.362503 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:33.649411 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9422b2f2-1b38-459e-8de5-7cbd1e6270de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:33.660003 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9422b2f2-1b38-459e-8de5-7cbd1e6270de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.359103 Dec 18 03:14:33.669762 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:33.670961 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 198/379] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:33 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:33.680458 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:33.682365 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:33.683711 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3dd09d61-9478-47d4-be9f-7d2fc452e309 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1722 microversion: 2.20 time: 0.343531 Dec 18 03:14:33.684773 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 182/380] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:33 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:33.719640 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c38ad005-c48a-4132-b3cb-26cffefe8649 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:33.720984 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c38ad005-c48a-4132-b3cb-26cffefe8649 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:33.729609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c38ad005-c48a-4132-b3cb-26cffefe8649 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:33.730343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c38ad005-c48a-4132-b3cb-26cffefe8649 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:33.731854 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c38ad005-c48a-4132-b3cb-26cffefe8649 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:33.732306 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c38ad005-c48a-4132-b3cb-26cffefe8649 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:33.909733 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c38ad005-c48a-4132-b3cb-26cffefe8649 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:33.920132 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c38ad005-c48a-4132-b3cb-26cffefe8649 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1503 microversion: 2.1 time: 0.204415 Dec 18 03:14:33.929298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 199/381] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:33 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:34.054495 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-404a75d6-ceec-4343-8226-82e644343e67 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:34.055709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-404a75d6-ceec-4343-8226-82e644343e67 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:34.064346 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-404a75d6-ceec-4343-8226-82e644343e67 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:34.065073 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-404a75d6-ceec-4343-8226-82e644343e67 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:34.066089 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-404a75d6-ceec-4343-8226-82e644343e67 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:34.067878 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-404a75d6-ceec-4343-8226-82e644343e67 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:34.289526 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-404a75d6-ceec-4343-8226-82e644343e67 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:34.297828 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-404a75d6-ceec-4343-8226-82e644343e67 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.247898 Dec 18 03:14:34.298722 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 183/382] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:34 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:34.677317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3ddacfb5-8dc8-4ada-9075-a129e9774100 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:34.678202 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3ddacfb5-8dc8-4ada-9075-a129e9774100 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:34.685717 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ddacfb5-8dc8-4ada-9075-a129e9774100 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:34.686337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ddacfb5-8dc8-4ada-9075-a129e9774100 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:34.687130 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ddacfb5-8dc8-4ada-9075-a129e9774100 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:34.687564 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ddacfb5-8dc8-4ada-9075-a129e9774100 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:34.703409 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:34.704256 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:34.711620 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:34.712053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:34.712993 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:34.713428 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:34.845160 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3ddacfb5-8dc8-4ada-9075-a129e9774100 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:34.857025 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3ddacfb5-8dc8-4ada-9075-a129e9774100 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.183211 Dec 18 03:14:34.865691 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 200/383] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:34 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:34.887034 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:34.897575 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:34.900013 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:34.901653 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-86791e39-effe-48a9-8ff5-937abf06902e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1722 microversion: 2.20 time: 0.201917 Dec 18 03:14:34.902679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 184/384] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:34 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:14:34.936059 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ed53bae5-860c-4f35-9058-d50f93270c5e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:34.936761 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ed53bae5-860c-4f35-9058-d50f93270c5e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:34.944153 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ed53bae5-860c-4f35-9058-d50f93270c5e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:34.945063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ed53bae5-860c-4f35-9058-d50f93270c5e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:34.945404 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ed53bae5-860c-4f35-9058-d50f93270c5e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:34.945865 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ed53bae5-860c-4f35-9058-d50f93270c5e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:35.117966 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ed53bae5-860c-4f35-9058-d50f93270c5e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:35.125875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ed53bae5-860c-4f35-9058-d50f93270c5e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1503 microversion: 2.1 time: 0.193379 Dec 18 03:14:35.126715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 201/385] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:34 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:35.315436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-78223c99-d2d0-4feb-b355-69999b49864f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:35.316041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-78223c99-d2d0-4feb-b355-69999b49864f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:35.323688 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-78223c99-d2d0-4feb-b355-69999b49864f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:35.324271 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-78223c99-d2d0-4feb-b355-69999b49864f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:35.325186 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-78223c99-d2d0-4feb-b355-69999b49864f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:35.325608 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-78223c99-d2d0-4feb-b355-69999b49864f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:35.477207 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-78223c99-d2d0-4feb-b355-69999b49864f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:35.484871 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-78223c99-d2d0-4feb-b355-69999b49864f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1318 microversion: 2.1 time: 0.173058 Dec 18 03:14:35.495537 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 185/386] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:35 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:35.874866 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ae7f44c7-edfb-4e8e-89f8-315e8a465bc2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:35.875486 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ae7f44c7-edfb-4e8e-89f8-315e8a465bc2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:35.882586 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ae7f44c7-edfb-4e8e-89f8-315e8a465bc2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:35.883032 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ae7f44c7-edfb-4e8e-89f8-315e8a465bc2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:35.883813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ae7f44c7-edfb-4e8e-89f8-315e8a465bc2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:35.884242 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ae7f44c7-edfb-4e8e-89f8-315e8a465bc2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:35.924882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:35.925487 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:35.932214 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:35.932659 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:35.933454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:35.933977 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:36.070404 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:36.078447 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:36.080006 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:36.081347 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-eb362d12-5fa0-4630-ab50-fd7d483e7ca7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1722 microversion: 2.20 time: 0.160117 Dec 18 03:14:36.092828 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 186/387] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:35 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:14:36.108074 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ae7f44c7-edfb-4e8e-89f8-315e8a465bc2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:36.120292 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ae7f44c7-edfb-4e8e-89f8-315e8a465bc2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.249072 Dec 18 03:14:36.120956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 202/388] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:35 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:36.143212 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4f4d599e-897f-497b-8f84-280952f5306e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:36.144100 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4f4d599e-897f-497b-8f84-280952f5306e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:36.150804 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4f4d599e-897f-497b-8f84-280952f5306e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:36.151290 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4f4d599e-897f-497b-8f84-280952f5306e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:36.152020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4f4d599e-897f-497b-8f84-280952f5306e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:36.152444 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4f4d599e-897f-497b-8f84-280952f5306e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:36.340832 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4f4d599e-897f-497b-8f84-280952f5306e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:36.349727 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4f4d599e-897f-497b-8f84-280952f5306e tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1503 microversion: 2.1 time: 0.209934 Dec 18 03:14:36.350395 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 187/389] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:36 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:36.503266 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3299c048-a2b3-4232-82aa-c2a54b29a663 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:36.503960 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3299c048-a2b3-4232-82aa-c2a54b29a663 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:36.513704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3299c048-a2b3-4232-82aa-c2a54b29a663 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:36.514684 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3299c048-a2b3-4232-82aa-c2a54b29a663 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:36.515897 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3299c048-a2b3-4232-82aa-c2a54b29a663 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:36.516725 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3299c048-a2b3-4232-82aa-c2a54b29a663 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:36.624436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-bb4fef58-9c02-4d8d-8757-bc2e3471b799 req-c1d54bc6-9a70-41b2-bc07-90d666e9a09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d29639a-4553-421a-aa64-08117561d492", "name": "network-vif-deleted", "tag": "f4969446-259d-42d4-85a3-d1fddce60b47"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:36.626539 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:36.626539 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:14:36.634836 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-bb4fef58-9c02-4d8d-8757-bc2e3471b799 req-c1d54bc6-9a70-41b2-bc07-90d666e9a09a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:36.635345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-bb4fef58-9c02-4d8d-8757-bc2e3471b799 req-c1d54bc6-9a70-41b2-bc07-90d666e9a09a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:36.650605 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-bb4fef58-9c02-4d8d-8757-bc2e3471b799 req-c1d54bc6-9a70-41b2-bc07-90d666e9a09a service nova] Creating event network-vif-deleted:f4969446-259d-42d4-85a3-d1fddce60b47 for instance 0d29639a-4553-421a-aa64-08117561d492 on hv-cinder-81803 Dec 18 03:14:36.656011 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-bb4fef58-9c02-4d8d-8757-bc2e3471b799 req-c1d54bc6-9a70-41b2-bc07-90d666e9a09a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036093 Dec 18 03:14:36.657012 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 188/390] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:14:36.708451 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3299c048-a2b3-4232-82aa-c2a54b29a663 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:36.716169 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3299c048-a2b3-4232-82aa-c2a54b29a663 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1509 microversion: 2.1 time: 0.217382 Dec 18 03:14:36.716794 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 203/391] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:36 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:37.101811 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:37.102543 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:37.108855 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:37.109292 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:37.110095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:37.110518 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:37.136324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-40e973d2-21fd-4de8-93d7-f664c36407ea tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:37.136942 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-40e973d2-21fd-4de8-93d7-f664c36407ea tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:37.143455 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-40e973d2-21fd-4de8-93d7-f664c36407ea tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:37.143905 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-40e973d2-21fd-4de8-93d7-f664c36407ea tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:37.144680 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-40e973d2-21fd-4de8-93d7-f664c36407ea tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:37.145111 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-40e973d2-21fd-4de8-93d7-f664c36407ea tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:37.260504 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:37.270137 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:37.282959 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:37.284590 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-22fe96cc-4f71-47ee-a9c4-5de0435e9bcf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1722 microversion: 2.20 time: 0.187853 Dec 18 03:14:37.285579 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 189/392] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:37 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:37.301533 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-40e973d2-21fd-4de8-93d7-f664c36407ea tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:37.311408 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-40e973d2-21fd-4de8-93d7-f664c36407ea tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.178514 Dec 18 03:14:37.312464 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 204/393] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:37 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:37.369279 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:37.369990 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:37.376138 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:37.376581 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:37.377388 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:37.377871 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:37.418139 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:37.418596 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:37.419050 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lazy-loading 'fault' on Instance uuid 0d29639a-4553-421a-aa64-08117561d492 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:14:37.477765 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb75fbada72413da5ed9a1b24f1ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720269d188094f32978b00a4858a2da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:37.485417 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d8584f2c-43c2-4042-97cc-5a814a10c7d8 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 200 len: 1303 microversion: 2.1 time: 0.122017 Dec 18 03:14:37.486020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 190/394] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:37 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:38.041880 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-16084d1b-b6cf-4eba-8d28-8c7ab188cdb0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "707d8a3b-9d24-4c64-990e-c71035fca9c0"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:38.042979 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-16084d1b-b6cf-4eba-8d28-8c7ab188cdb0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:38.048828 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-16084d1b-b6cf-4eba-8d28-8c7ab188cdb0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.049262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-16084d1b-b6cf-4eba-8d28-8c7ab188cdb0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.050051 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-16084d1b-b6cf-4eba-8d28-8c7ab188cdb0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.050478 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-16084d1b-b6cf-4eba-8d28-8c7ab188cdb0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.233295 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-d8b2b82d-a085-41ff-95b5-7f899f541e89 req-8cb6ebd8-5fb5-4d06-93c3-cf36921eef3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa82caa-8340-4f50-9989-2ddbc243fb40", "name": "network-vif-unplugged", "status": "completed", "tag": "b9de074c-64ba-4630-b439-f53e09e04d4b"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:38.235165 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:38.235165 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:14:38.262010 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-d8b2b82d-a085-41ff-95b5-7f899f541e89 req-8cb6ebd8-5fb5-4d06-93c3-cf36921eef3e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.262369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-d8b2b82d-a085-41ff-95b5-7f899f541e89 req-8cb6ebd8-5fb5-4d06-93c3-cf36921eef3e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.280635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-d8b2b82d-a085-41ff-95b5-7f899f541e89 req-8cb6ebd8-5fb5-4d06-93c3-cf36921eef3e service nova] Creating event network-vif-unplugged:b9de074c-64ba-4630-b439-f53e09e04d4b for instance aaa82caa-8340-4f50-9989-2ddbc243fb40 on hv-cinder-81803 Dec 18 03:14:38.290177 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-d8b2b82d-a085-41ff-95b5-7f899f541e89 req-8cb6ebd8-5fb5-4d06-93c3-cf36921eef3e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060133 Dec 18 03:14:38.292090 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 191/395] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:38 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:38.309816 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:38.311133 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:38.321154 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.322040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.322485 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.323051 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.353913 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-16084d1b-b6cf-4eba-8d28-8c7ab188cdb0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "POST /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315550 Dec 18 03:14:38.360955 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 205/396] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:14:38 2021] POST /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:38.368258 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-db8b1819-382f-477b-bd21-d2a0bb68e532 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:38.369324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-db8b1819-382f-477b-bd21-d2a0bb68e532 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:38.377145 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-db8b1819-382f-477b-bd21-d2a0bb68e532 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.378785 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-db8b1819-382f-477b-bd21-d2a0bb68e532 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.380108 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-db8b1819-382f-477b-bd21-d2a0bb68e532 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.380892 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-db8b1819-382f-477b-bd21-d2a0bb68e532 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.517839 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:38.529480 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:38.531703 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:38.533132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e62c683d-d2f9-41b3-8a69-fdce82f51b04 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1725 microversion: 2.20 time: 0.231401 Dec 18 03:14:38.538223 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 192/397] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:38 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:14:38.559765 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-aef697c1-0048-41ec-bc92-50c8bd440ff7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:38.560423 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-aef697c1-0048-41ec-bc92-50c8bd440ff7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] [instance: 0d29639a-4553-421a-aa64-08117561d492] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:38.566488 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aef697c1-0048-41ec-bc92-50c8bd440ff7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.566929 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aef697c1-0048-41ec-bc92-50c8bd440ff7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.567709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aef697c1-0048-41ec-bc92-50c8bd440ff7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.568757 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aef697c1-0048-41ec-bc92-50c8bd440ff7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.575857 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-db8b1819-382f-477b-bd21-d2a0bb68e532 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:38.583397 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-aef697c1-0048-41ec-bc92-50c8bd440ff7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] HTTP exception thrown: Instance 0d29639a-4553-421a-aa64-08117561d492 could not be found. Dec 18 03:14:38.584908 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-aef697c1-0048-41ec-bc92-50c8bd440ff7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] Returning 404 to user: Instance 0d29639a-4553-421a-aa64-08117561d492 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:14:38.585749 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-aef697c1-0048-41ec-bc92-50c8bd440ff7 tempest-VolumesActionsTest-443512824 tempest-VolumesActionsTest-443512824-project] 10.222.0.24 "GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492" status: 404 len: 111 microversion: 2.1 time: 0.044583 Dec 18 03:14:38.586342 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 193/398] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:38 2021] GET /compute/v2.1/servers/0d29639a-4553-421a-aa64-08117561d492 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:14:38.588157 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-db8b1819-382f-477b-bd21-d2a0bb68e532 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.224593 Dec 18 03:14:38.593690 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 206/399] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:38 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:38.601978 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8e75232f-c852-4f5b-85ee-148693a3d05a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9191e04-710d-4173-a6aa-734b5fb69877"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:38.603359 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8e75232f-c852-4f5b-85ee-148693a3d05a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:38.610912 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8e75232f-c852-4f5b-85ee-148693a3d05a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.611496 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8e75232f-c852-4f5b-85ee-148693a3d05a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:38.612279 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8e75232f-c852-4f5b-85ee-148693a3d05a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:38.612886 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8e75232f-c852-4f5b-85ee-148693a3d05a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:39.020044 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8e75232f-c852-4f5b-85ee-148693a3d05a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.432150 Dec 18 03:14:39.021125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 194/400] 10.222.0.24 () {62 vars in 1363 bytes} [Sat Dec 18 03:14:38 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:14:39.158838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6a07818c-286b-4a12-ae50-dd85676c811f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:39.159573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6a07818c-286b-4a12-ae50-dd85676c811f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:39.169382 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6a07818c-286b-4a12-ae50-dd85676c811f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:39.169862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6a07818c-286b-4a12-ae50-dd85676c811f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:39.170850 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6a07818c-286b-4a12-ae50-dd85676c811f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:39.171286 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6a07818c-286b-4a12-ae50-dd85676c811f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:39.281675 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6a07818c-286b-4a12-ae50-dd85676c811f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action" status: 202 len: 0 microversion: 2.20 time: 0.126822 Dec 18 03:14:39.285963 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 207/401] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:14:39 2021] POST /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 18 03:14:39.291344 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:39.291983 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:39.299121 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:39.299567 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:39.300355 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:39.300785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:39.468229 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:39.477061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:39.478629 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:39.480040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3925ae0a-6be4-4810-a422-67647bd28d47 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1751 microversion: 2.20 time: 0.192561 Dec 18 03:14:39.480544 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 195/402] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:39 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:39.605489 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9124841f-4c6d-4a0d-95b0-ac421ee29c71 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:39.606125 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9124841f-4c6d-4a0d-95b0-ac421ee29c71 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:39.612030 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9124841f-4c6d-4a0d-95b0-ac421ee29c71 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:39.612475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9124841f-4c6d-4a0d-95b0-ac421ee29c71 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:39.613251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9124841f-4c6d-4a0d-95b0-ac421ee29c71 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:39.613701 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9124841f-4c6d-4a0d-95b0-ac421ee29c71 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:39.752456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9124841f-4c6d-4a0d-95b0-ac421ee29c71 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:39.760637 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9124841f-4c6d-4a0d-95b0-ac421ee29c71 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.159019 Dec 18 03:14:39.761205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 208/403] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:39 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:40.500509 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:40.501145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:40.508491 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:40.508955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:40.509755 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:40.510187 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:40.643864 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:40.653222 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:40.654744 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:40.655959 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4cd3dabb-ee83-4100-8566-ba0ce2d35fc7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1751 microversion: 2.20 time: 0.160294 Dec 18 03:14:40.656513 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 196/404] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:40 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:40.778205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3d539566-2f18-479b-9fbc-bfbb4c9738f2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:40.778761 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3d539566-2f18-479b-9fbc-bfbb4c9738f2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:40.785324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d539566-2f18-479b-9fbc-bfbb4c9738f2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:40.785796 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d539566-2f18-479b-9fbc-bfbb4c9738f2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:40.786586 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d539566-2f18-479b-9fbc-bfbb4c9738f2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:40.787571 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d539566-2f18-479b-9fbc-bfbb4c9738f2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:40.941268 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3d539566-2f18-479b-9fbc-bfbb4c9738f2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:40.950001 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3d539566-2f18-479b-9fbc-bfbb4c9738f2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.175321 Dec 18 03:14:40.963182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 209/405] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:40 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:41.674631 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:41.675239 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:41.682131 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:41.682570 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:41.683339 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:41.683765 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:41.812789 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:41.821226 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:41.822745 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:41.823895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-664f3ec0-ef20-4337-b0bb-98cd507658bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1751 microversion: 2.20 time: 0.153040 Dec 18 03:14:41.824693 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 197/406] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:41 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:41.966847 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f507a30c-6011-4275-9129-32e9a17151db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:41.967281 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f507a30c-6011-4275-9129-32e9a17151db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:41.973341 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f507a30c-6011-4275-9129-32e9a17151db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:41.974430 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f507a30c-6011-4275-9129-32e9a17151db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:41.975212 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f507a30c-6011-4275-9129-32e9a17151db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:41.975637 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f507a30c-6011-4275-9129-32e9a17151db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:42.107054 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f507a30c-6011-4275-9129-32e9a17151db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:42.114403 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f507a30c-6011-4275-9129-32e9a17151db tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.151251 Dec 18 03:14:42.115589 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 210/407] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:41 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:42.841931 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:42.842542 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:42.848693 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:42.849676 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:42.850454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:42.850880 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:42.980068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:42.988504 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:42.990204 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:42.991417 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8b87f171-8a24-4c9d-91dd-63ee7cc18650 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1751 microversion: 2.20 time: 0.153089 Dec 18 03:14:42.991882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 198/408] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:42 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:43.130991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-019abdbb-a18c-4c9a-86f2-afc7019d8a3b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:43.131602 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-019abdbb-a18c-4c9a-86f2-afc7019d8a3b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:43.137808 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-019abdbb-a18c-4c9a-86f2-afc7019d8a3b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:43.138255 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-019abdbb-a18c-4c9a-86f2-afc7019d8a3b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:43.139012 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-019abdbb-a18c-4c9a-86f2-afc7019d8a3b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:43.139456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-019abdbb-a18c-4c9a-86f2-afc7019d8a3b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:43.267208 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-019abdbb-a18c-4c9a-86f2-afc7019d8a3b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:43.275032 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-019abdbb-a18c-4c9a-86f2-afc7019d8a3b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.147878 Dec 18 03:14:43.275586 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 211/409] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:43 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:44.009590 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:44.010216 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:44.016422 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:44.016862 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:44.017633 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:44.018069 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:44.153590 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:44.161766 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:44.163179 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:44.164342 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-75e9fb02-2f6e-4602-be76-b837489020aa tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1751 microversion: 2.20 time: 0.158895 Dec 18 03:14:44.164886 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 199/410] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:44 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:44.291557 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bd2ae45a-e31b-49ca-9993-c3ec3722b437 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:44.292087 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bd2ae45a-e31b-49ca-9993-c3ec3722b437 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:44.298355 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bd2ae45a-e31b-49ca-9993-c3ec3722b437 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:44.298801 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bd2ae45a-e31b-49ca-9993-c3ec3722b437 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:44.299571 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bd2ae45a-e31b-49ca-9993-c3ec3722b437 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:44.300004 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bd2ae45a-e31b-49ca-9993-c3ec3722b437 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:44.426541 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bd2ae45a-e31b-49ca-9993-c3ec3722b437 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:44.434514 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bd2ae45a-e31b-49ca-9993-c3ec3722b437 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.146699 Dec 18 03:14:44.435078 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 212/411] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:44 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:45.182168 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:45.182777 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:45.189059 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:45.189498 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:45.190298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:45.190729 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:45.323138 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:45.331274 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:45.332682 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:45.334362 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8fdfbd30-44f6-4cdd-85a2-972855420696 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1753 microversion: 2.20 time: 0.155813 Dec 18 03:14:45.334988 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 200/412] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:45 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:45.451553 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c5f9a45d-e34a-4b51-9c43-b224360436cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:45.452150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c5f9a45d-e34a-4b51-9c43-b224360436cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:45.458923 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5f9a45d-e34a-4b51-9c43-b224360436cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:45.459525 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5f9a45d-e34a-4b51-9c43-b224360436cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:45.460236 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5f9a45d-e34a-4b51-9c43-b224360436cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:45.460734 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c5f9a45d-e34a-4b51-9c43-b224360436cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:45.588233 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c5f9a45d-e34a-4b51-9c43-b224360436cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:45.595811 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c5f9a45d-e34a-4b51-9c43-b224360436cc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.147894 Dec 18 03:14:45.605644 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 213/413] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:45 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:46.352365 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:46.352972 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:46.359876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:46.360328 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:46.361452 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:46.361909 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:46.426914 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7941d38f-53c8-40f3-9ebe-e941542e3fb8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:46.427764 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7941d38f-53c8-40f3-9ebe-e941542e3fb8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:46.434875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7941d38f-53c8-40f3-9ebe-e941542e3fb8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:46.435435 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7941d38f-53c8-40f3-9ebe-e941542e3fb8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:46.436190 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7941d38f-53c8-40f3-9ebe-e941542e3fb8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:46.436654 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7941d38f-53c8-40f3-9ebe-e941542e3fb8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:46.501712 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:46.510986 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:46.512734 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:46.514124 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d4e4238c-c177-48bb-8e46-269eaac1844b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1753 microversion: 2.20 time: 0.165492 Dec 18 03:14:46.518055 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 201/414] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:46 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:46.522999 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-7941d38f-53c8-40f3-9ebe-e941542e3fb8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lazy-loading 'services' on Instance uuid c701ed3f-302c-4f83-8e8f-1c9932a9e349 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:14:46.600351 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7941d38f-53c8-40f3-9ebe-e941542e3fb8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments/707d8a3b-9d24-4c64-990e-c71035fca9c0" status: 202 len: 0 microversion: 2.1 time: 0.176750 Dec 18 03:14:46.601159 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 214/415] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:14:46 2021] DELETE /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments/707d8a3b-9d24-4c64-990e-c71035fca9c0 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:14:46.609639 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-faea50b3-c85f-4520-8030-dd120f79a08d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:46.610910 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-faea50b3-c85f-4520-8030-dd120f79a08d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:46.618432 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-faea50b3-c85f-4520-8030-dd120f79a08d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:46.619421 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-922dba0f-b8ca-48c3-9242-b31e3a1bcf7d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:46.619721 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-faea50b3-c85f-4520-8030-dd120f79a08d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:46.620181 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-922dba0f-b8ca-48c3-9242-b31e3a1bcf7d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:46.621556 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-faea50b3-c85f-4520-8030-dd120f79a08d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:46.622318 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-faea50b3-c85f-4520-8030-dd120f79a08d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:46.627422 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-922dba0f-b8ca-48c3-9242-b31e3a1bcf7d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:46.627971 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-922dba0f-b8ca-48c3-9242-b31e3a1bcf7d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:46.629047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-922dba0f-b8ca-48c3-9242-b31e3a1bcf7d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:46.629489 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-922dba0f-b8ca-48c3-9242-b31e3a1bcf7d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:46.658495 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-faea50b3-c85f-4520-8030-dd120f79a08d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052822 Dec 18 03:14:46.662549 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 202/416] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:14:46 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:14:46.985133 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-922dba0f-b8ca-48c3-9242-b31e3a1bcf7d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:46.994198 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-922dba0f-b8ca-48c3-9242-b31e3a1bcf7d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.379559 Dec 18 03:14:46.994767 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 215/417] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:46 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:47.535946 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:47.536488 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:47.542911 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:47.543435 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:47.544295 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:47.544798 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:47.670221 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f88f1925-6f13-4d11-a9af-cac657ceb4ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:47.671893 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f88f1925-6f13-4d11-a9af-cac657ceb4ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:47.679713 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f88f1925-6f13-4d11-a9af-cac657ceb4ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:47.680483 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f88f1925-6f13-4d11-a9af-cac657ceb4ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:47.681523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f88f1925-6f13-4d11-a9af-cac657ceb4ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:47.682186 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f88f1925-6f13-4d11-a9af-cac657ceb4ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:47.697927 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:47.706410 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:47.709854 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:47.711605 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7fe48b36-ba76-43a6-851d-c7d6a6ad3a1f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.179441 Dec 18 03:14:47.712254 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 203/418] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:47 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:47.714591 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f88f1925-6f13-4d11-a9af-cac657ceb4ec tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048151 Dec 18 03:14:47.715342 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 216/419] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:14:47 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:48.012479 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3740ff7c-4d61-4d7a-b2bb-9265ff1ca914 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:48.013091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3740ff7c-4d61-4d7a-b2bb-9265ff1ca914 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:48.019691 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3740ff7c-4d61-4d7a-b2bb-9265ff1ca914 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:48.023005 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3740ff7c-4d61-4d7a-b2bb-9265ff1ca914 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:48.026611 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3740ff7c-4d61-4d7a-b2bb-9265ff1ca914 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:48.027142 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3740ff7c-4d61-4d7a-b2bb-9265ff1ca914 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:48.177992 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3740ff7c-4d61-4d7a-b2bb-9265ff1ca914 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:48.185394 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3740ff7c-4d61-4d7a-b2bb-9265ff1ca914 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.176762 Dec 18 03:14:48.185984 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 204/420] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:48 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:48.728042 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-da4e07fc-a604-4922-91c8-4e6e7dad0377 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:48.729515 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-da4e07fc-a604-4922-91c8-4e6e7dad0377 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:48.731318 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:48.732148 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:48.738230 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da4e07fc-a604-4922-91c8-4e6e7dad0377 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:48.738784 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da4e07fc-a604-4922-91c8-4e6e7dad0377 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:48.739366 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:48.740073 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da4e07fc-a604-4922-91c8-4e6e7dad0377 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:48.740613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:48.740749 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da4e07fc-a604-4922-91c8-4e6e7dad0377 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:48.741962 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:48.742623 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:48.781396 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-da4e07fc-a604-4922-91c8-4e6e7dad0377 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059286 Dec 18 03:14:48.781908 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 217/421] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:14:48 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:14:48.918891 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:48.927778 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:48.929247 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:48.930431 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5a19f3e2-dc86-47eb-89d6-4addf46e5776 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.203294 Dec 18 03:14:48.930989 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 205/422] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:48 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:14:49.202566 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7cb0be48-2da8-473b-910e-3de555e4a90f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:49.203214 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7cb0be48-2da8-473b-910e-3de555e4a90f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:49.209723 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7cb0be48-2da8-473b-910e-3de555e4a90f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:49.210181 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7cb0be48-2da8-473b-910e-3de555e4a90f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:49.210955 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7cb0be48-2da8-473b-910e-3de555e4a90f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:49.211391 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7cb0be48-2da8-473b-910e-3de555e4a90f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:49.353162 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7cb0be48-2da8-473b-910e-3de555e4a90f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:49.360925 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7cb0be48-2da8-473b-910e-3de555e4a90f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.162005 Dec 18 03:14:49.362177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 218/423] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:49 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:49.950856 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:49.951873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:49.960138 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:49.960577 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:49.961799 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:49.962224 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:49.993824 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-34fc967c-6769-4099-b010-e5bff32c111a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:49.994305 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-34fc967c-6769-4099-b010-e5bff32c111a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:50.000945 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-34fc967c-6769-4099-b010-e5bff32c111a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:50.001389 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-34fc967c-6769-4099-b010-e5bff32c111a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:50.002568 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-34fc967c-6769-4099-b010-e5bff32c111a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:50.003003 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-34fc967c-6769-4099-b010-e5bff32c111a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:50.035882 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-34fc967c-6769-4099-b010-e5bff32c111a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:14:50.120795 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:50.124273 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-34fc967c-6769-4099-b010-e5bff32c111a tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 204 len: 0 microversion: 2.1 time: 0.133173 Dec 18 03:14:50.124423 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 219/424] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:14:49 2021] DELETE /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:14:50.132235 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:50.134316 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:50.136144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-79101dab-305e-4edc-a575-80649d9573d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.189326 Dec 18 03:14:50.137568 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 206/425] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:49 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:50.139609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-65097634-7ffd-4182-9f5e-eb9b05b560d0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:50.140348 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-65097634-7ffd-4182-9f5e-eb9b05b560d0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:50.146427 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65097634-7ffd-4182-9f5e-eb9b05b560d0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:50.146877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65097634-7ffd-4182-9f5e-eb9b05b560d0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:50.147801 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65097634-7ffd-4182-9f5e-eb9b05b560d0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:50.148424 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65097634-7ffd-4182-9f5e-eb9b05b560d0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:50.284788 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-65097634-7ffd-4182-9f5e-eb9b05b560d0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:50.292099 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-65097634-7ffd-4182-9f5e-eb9b05b560d0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1515 microversion: 2.1 time: 0.156790 Dec 18 03:14:50.292652 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 220/426] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:50 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:50.383515 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ea462972-9ec2-4baf-9b1f-bc8b9c3fce4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:50.384303 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ea462972-9ec2-4baf-9b1f-bc8b9c3fce4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:50.391238 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ea462972-9ec2-4baf-9b1f-bc8b9c3fce4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:50.391777 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ea462972-9ec2-4baf-9b1f-bc8b9c3fce4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:50.392651 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ea462972-9ec2-4baf-9b1f-bc8b9c3fce4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:50.393177 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ea462972-9ec2-4baf-9b1f-bc8b9c3fce4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:50.530126 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ea462972-9ec2-4baf-9b1f-bc8b9c3fce4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:50.537994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ea462972-9ec2-4baf-9b1f-bc8b9c3fce4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.159648 Dec 18 03:14:50.538570 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 207/427] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:50 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:51.163761 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:51.164352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:51.170675 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:51.171123 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:51.171892 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:51.172334 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:51.305521 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:51.323434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:51.324321 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:51.333775 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b0080144-f1c2-405a-bcf4-8e999f94bf18 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:51.335151 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-fe77c0a6-af79-498a-8ddc-f6d3bb1aa56e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.171006 Dec 18 03:14:51.340112 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b0080144-f1c2-405a-bcf4-8e999f94bf18 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:51.347225 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b0080144-f1c2-405a-bcf4-8e999f94bf18 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:51.347943 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b0080144-f1c2-405a-bcf4-8e999f94bf18 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:51.349497 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b0080144-f1c2-405a-bcf4-8e999f94bf18 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:51.350100 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b0080144-f1c2-405a-bcf4-8e999f94bf18 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:51.353327 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 221/428] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:51 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:51.536998 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3676eeee-eaa0-4c3f-a834-80b1918fa5a7 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f40814b9-5aa6-4b71-802c-2d4bf1809f93", "device": "/dev/sdb"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:51.539736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3676eeee-eaa0-4c3f-a834-80b1918fa5a7 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:51.547565 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3676eeee-eaa0-4c3f-a834-80b1918fa5a7 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:51.550815 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3676eeee-eaa0-4c3f-a834-80b1918fa5a7 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:51.553060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3676eeee-eaa0-4c3f-a834-80b1918fa5a7 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:51.554033 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3676eeee-eaa0-4c3f-a834-80b1918fa5a7 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:51.578245 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b0080144-f1c2-405a-bcf4-8e999f94bf18 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:51.586810 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b0080144-f1c2-405a-bcf4-8e999f94bf18 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1515 microversion: 2.1 time: 0.281795 Dec 18 03:14:51.587375 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 208/429] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:51 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:51.591554 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-309420cf-3419-467c-8faa-939f6e0ff0a1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:51.592149 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-309420cf-3419-467c-8faa-939f6e0ff0a1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:51.598069 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-309420cf-3419-467c-8faa-939f6e0ff0a1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:51.599246 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-309420cf-3419-467c-8faa-939f6e0ff0a1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:51.600213 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-309420cf-3419-467c-8faa-939f6e0ff0a1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:51.600832 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-309420cf-3419-467c-8faa-939f6e0ff0a1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:51.751262 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-309420cf-3419-467c-8faa-939f6e0ff0a1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:51.759785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-309420cf-3419-467c-8faa-939f6e0ff0a1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.171434 Dec 18 03:14:51.760760 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 209/430] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:51 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:51.848232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3676eeee-eaa0-4c3f-a834-80b1918fa5a7 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "POST /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317146 Dec 18 03:14:51.849029 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 222/431] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:14:51 2021] POST /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:14:52.358512 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:52.359073 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:52.365847 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:52.366327 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:52.367316 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:52.367799 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:52.512179 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:52.520547 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:52.522850 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:52.524009 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ff1ac7d3-4086-4253-8081-142ff282b286 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.169566 Dec 18 03:14:52.524563 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 210/432] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:52 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:52.604563 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-23d18903-1f06-4f54-9e2b-454cbacd2e4e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:52.605568 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-23d18903-1f06-4f54-9e2b-454cbacd2e4e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:52.611575 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23d18903-1f06-4f54-9e2b-454cbacd2e4e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:52.612024 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23d18903-1f06-4f54-9e2b-454cbacd2e4e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:52.612804 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23d18903-1f06-4f54-9e2b-454cbacd2e4e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:52.613241 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23d18903-1f06-4f54-9e2b-454cbacd2e4e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:52.778007 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2b7c4714-a090-4d04-8dae-ab922987c5b7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:52.779043 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2b7c4714-a090-4d04-8dae-ab922987c5b7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:52.786293 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b7c4714-a090-4d04-8dae-ab922987c5b7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:52.786743 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b7c4714-a090-4d04-8dae-ab922987c5b7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:52.787532 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b7c4714-a090-4d04-8dae-ab922987c5b7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:52.788176 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2b7c4714-a090-4d04-8dae-ab922987c5b7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:52.861468 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-23d18903-1f06-4f54-9e2b-454cbacd2e4e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:52.872064 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-23d18903-1f06-4f54-9e2b-454cbacd2e4e tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1515 microversion: 2.1 time: 0.271799 Dec 18 03:14:52.873472 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 223/433] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:52 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:52.955863 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2b7c4714-a090-4d04-8dae-ab922987c5b7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:52.965880 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2b7c4714-a090-4d04-8dae-ab922987c5b7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.191417 Dec 18 03:14:52.969076 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 211/434] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:52 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:53.357569 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-e06ce2e3-ae3a-4857-913a-da7466270ba1 req-229e8993-ad81-498e-b876-09d09d1491c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c701ed3f-302c-4f83-8e8f-1c9932a9e349", "name": "network-vif-deleted", "tag": "a6d3a37f-f909-4ef5-ac88-8d8b1dc87759"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:53.359782 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:53.359782 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:14:53.368089 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-e06ce2e3-ae3a-4857-913a-da7466270ba1 req-229e8993-ad81-498e-b876-09d09d1491c8 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:53.369515 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-e06ce2e3-ae3a-4857-913a-da7466270ba1 req-229e8993-ad81-498e-b876-09d09d1491c8 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:53.381362 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-e06ce2e3-ae3a-4857-913a-da7466270ba1 req-229e8993-ad81-498e-b876-09d09d1491c8 service nova] Creating event network-vif-deleted:a6d3a37f-f909-4ef5-ac88-8d8b1dc87759 for instance c701ed3f-302c-4f83-8e8f-1c9932a9e349 on hv-cinder-81803 Dec 18 03:14:53.387410 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-e06ce2e3-ae3a-4857-913a-da7466270ba1 req-229e8993-ad81-498e-b876-09d09d1491c8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034383 Dec 18 03:14:53.391162 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 224/435] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:53.542612 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:53.543230 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:53.551328 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:53.554471 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:53.556915 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:53.557663 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:53.731079 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:53.741984 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:53.743866 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:53.745360 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4d2c4b20-8772-45e2-8efe-30c904f643de tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.206408 Dec 18 03:14:53.746691 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 212/436] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:53 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:53.890094 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:53.890798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:53.897213 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:53.897994 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:53.899165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:53.899608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:53.939326 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:53.939773 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:53.940540 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lazy-loading 'fault' on Instance uuid c701ed3f-302c-4f83-8e8f-1c9932a9e349 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:14:53.986757 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e50ec574-f583-4da8-a6a4-5155ca2d66e6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:53.987604 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e50ec574-f583-4da8-a6a4-5155ca2d66e6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:53.994195 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e50ec574-f583-4da8-a6a4-5155ca2d66e6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:53.995004 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e50ec574-f583-4da8-a6a4-5155ca2d66e6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:53.995859 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e50ec574-f583-4da8-a6a4-5155ca2d66e6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:53.996494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e50ec574-f583-4da8-a6a4-5155ca2d66e6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:54.032846 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:54.043715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3a5a08be-11b3-4387-8822-cbc177dce93f tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 200 len: 1308 microversion: 2.1 time: 0.158074 Dec 18 03:14:54.045967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 225/437] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:53 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:54.164582 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e50ec574-f583-4da8-a6a4-5155ca2d66e6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:54.172921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e50ec574-f583-4da8-a6a4-5155ca2d66e6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.189993 Dec 18 03:14:54.173661 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 213/438] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:53 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:54.764623 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:54.765093 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:54.772008 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:54.772433 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:54.773203 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:54.773682 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:54.909541 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:54.917804 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:54.919287 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:54.920423 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1593cf33-0ec5-4fbc-87da-9ef3eda7c216 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.159675 Dec 18 03:14:54.920969 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 226/439] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:54 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:55.062617 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fa42f18f-df47-4c4e-a337-823f88589abf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:55.063263 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-fa42f18f-df47-4c4e-a337-823f88589abf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: c701ed3f-302c-4f83-8e8f-1c9932a9e349] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:55.070549 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fa42f18f-df47-4c4e-a337-823f88589abf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:55.070997 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fa42f18f-df47-4c4e-a337-823f88589abf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:55.071783 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fa42f18f-df47-4c4e-a337-823f88589abf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:55.072265 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fa42f18f-df47-4c4e-a337-823f88589abf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:55.093353 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-fa42f18f-df47-4c4e-a337-823f88589abf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] HTTP exception thrown: Instance c701ed3f-302c-4f83-8e8f-1c9932a9e349 could not be found. Dec 18 03:14:55.093995 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fa42f18f-df47-4c4e-a337-823f88589abf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Returning 404 to user: Instance c701ed3f-302c-4f83-8e8f-1c9932a9e349 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:14:55.094817 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-fa42f18f-df47-4c4e-a337-823f88589abf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349" status: 404 len: 111 microversion: 2.1 time: 0.036107 Dec 18 03:14:55.095527 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 214/440] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:55 2021] GET /compute/v2.1/servers/c701ed3f-302c-4f83-8e8f-1c9932a9e349 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 03:14:55.190789 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9bbde379-5134-4d59-8d61-467eae3143b0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:55.191729 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9bbde379-5134-4d59-8d61-467eae3143b0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:55.206084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9bbde379-5134-4d59-8d61-467eae3143b0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:55.206084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9bbde379-5134-4d59-8d61-467eae3143b0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:55.206084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9bbde379-5134-4d59-8d61-467eae3143b0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:55.206084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9bbde379-5134-4d59-8d61-467eae3143b0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:55.336784 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9bbde379-5134-4d59-8d61-467eae3143b0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:55.347041 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9bbde379-5134-4d59-8d61-467eae3143b0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.160351 Dec 18 03:14:55.347713 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 227/441] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:55 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:55.938847 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:55.939578 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:55.946161 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:55.946687 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:55.947541 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:55.947977 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:56.088564 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:56.097074 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:56.098624 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:56.100715 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-de2cbf25-46be-40ca-91a0-ef591fcaa83e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.165649 Dec 18 03:14:56.101281 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 215/442] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:55 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:56.233534 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-616bd194-d56c-4b73-8cdb-29eee7cccea0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:56.234143 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-616bd194-d56c-4b73-8cdb-29eee7cccea0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:56.241199 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-616bd194-d56c-4b73-8cdb-29eee7cccea0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:56.241679 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-616bd194-d56c-4b73-8cdb-29eee7cccea0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:56.242503 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-616bd194-d56c-4b73-8cdb-29eee7cccea0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:56.242937 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-616bd194-d56c-4b73-8cdb-29eee7cccea0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:56.269263 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-616bd194-d56c-4b73-8cdb-29eee7cccea0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:14:56.358237 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-616bd194-d56c-4b73-8cdb-29eee7cccea0 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "DELETE /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 204 len: 0 microversion: 2.1 time: 0.127936 Dec 18 03:14:56.359573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 228/443] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:14:56 2021] DELETE /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:14:56.367923 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e7c94762-4b7d-426d-a71f-85b09d975510 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:56.368886 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e7c94762-4b7d-426d-a71f-85b09d975510 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:56.372686 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3ede57c2-5ce6-4921-9fd6-071a494d89c2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:56.372985 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3ede57c2-5ce6-4921-9fd6-071a494d89c2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:56.376724 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e7c94762-4b7d-426d-a71f-85b09d975510 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:56.377167 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e7c94762-4b7d-426d-a71f-85b09d975510 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:56.377975 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e7c94762-4b7d-426d-a71f-85b09d975510 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:56.378398 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e7c94762-4b7d-426d-a71f-85b09d975510 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:56.379012 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ede57c2-5ce6-4921-9fd6-071a494d89c2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:56.379454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ede57c2-5ce6-4921-9fd6-071a494d89c2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:56.380473 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ede57c2-5ce6-4921-9fd6-071a494d89c2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:56.380907 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ede57c2-5ce6-4921-9fd6-071a494d89c2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:56.580416 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e7c94762-4b7d-426d-a71f-85b09d975510 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:56.591125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e7c94762-4b7d-426d-a71f-85b09d975510 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.228413 Dec 18 03:14:56.605690 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 216/444] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:56 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:56.606226 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3ede57c2-5ce6-4921-9fd6-071a494d89c2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:56.615489 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3ede57c2-5ce6-4921-9fd6-071a494d89c2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1514 microversion: 2.1 time: 0.248324 Dec 18 03:14:56.616058 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 229/445] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:56 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:57.121647 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:57.122223 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:57.129431 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:57.130115 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:57.131085 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:57.131758 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:57.297886 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:57.307081 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:57.308769 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:57.309829 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c7f55796-a771-4947-bee4-1bb5a45d8721 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.192014 Dec 18 03:14:57.310610 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 217/446] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:57 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:57.617013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c078e05b-705e-4fff-a9a7-7d2353168c19 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:57.617647 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c078e05b-705e-4fff-a9a7-7d2353168c19 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:57.625311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c078e05b-705e-4fff-a9a7-7d2353168c19 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:57.625817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c078e05b-705e-4fff-a9a7-7d2353168c19 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:57.626614 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c078e05b-705e-4fff-a9a7-7d2353168c19 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:57.627246 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c078e05b-705e-4fff-a9a7-7d2353168c19 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:57.631902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f6504141-91f9-4ec7-b0a2-f9c9646660e2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:57.632606 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f6504141-91f9-4ec7-b0a2-f9c9646660e2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:57.638384 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f6504141-91f9-4ec7-b0a2-f9c9646660e2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:57.638828 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f6504141-91f9-4ec7-b0a2-f9c9646660e2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:57.639609 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f6504141-91f9-4ec7-b0a2-f9c9646660e2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:57.640046 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f6504141-91f9-4ec7-b0a2-f9c9646660e2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:57.780013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c078e05b-705e-4fff-a9a7-7d2353168c19 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:57.789258 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c078e05b-705e-4fff-a9a7-7d2353168c19 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.176461 Dec 18 03:14:57.799013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 230/447] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:57 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:57.799328 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f6504141-91f9-4ec7-b0a2-f9c9646660e2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:57.800344 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f6504141-91f9-4ec7-b0a2-f9c9646660e2 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1514 microversion: 2.1 time: 0.171984 Dec 18 03:14:57.810595 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 218/448] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:57 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:14:58.328738 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:58.329451 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:58.336068 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:58.336508 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:58.337314 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:58.337783 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:58.484421 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:58.496168 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:58.498084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:58.499467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2c4317af-626b-4397-a595-91341d050e7a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.174945 Dec 18 03:14:58.510297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 231/449] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:58 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:14:58.807503 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-955745d4-705d-4fe0-b40b-abc2f9701ad3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:58.808238 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-955745d4-705d-4fe0-b40b-abc2f9701ad3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:58.818148 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0a462e0d-3357-4247-adba-70cf2217358d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:58.819045 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0a462e0d-3357-4247-adba-70cf2217358d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:58.826572 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0a462e0d-3357-4247-adba-70cf2217358d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:58.827174 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0a462e0d-3357-4247-adba-70cf2217358d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:58.828107 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0a462e0d-3357-4247-adba-70cf2217358d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:58.828685 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0a462e0d-3357-4247-adba-70cf2217358d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:58.833289 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-955745d4-705d-4fe0-b40b-abc2f9701ad3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:58.838171 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-955745d4-705d-4fe0-b40b-abc2f9701ad3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:58.839122 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-955745d4-705d-4fe0-b40b-abc2f9701ad3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:58.839668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-955745d4-705d-4fe0-b40b-abc2f9701ad3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:59.066829 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-955745d4-705d-4fe0-b40b-abc2f9701ad3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:59.078522 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-955745d4-705d-4fe0-b40b-abc2f9701ad3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.274241 Dec 18 03:14:59.091765 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 219/450] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:58 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:59.178577 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0a462e0d-3357-4247-adba-70cf2217358d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:59.186957 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0a462e0d-3357-4247-adba-70cf2217358d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 200 len: 1514 microversion: 2.1 time: 0.372900 Dec 18 03:14:59.188250 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 232/451] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:14:58 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 1514 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:14:59.370442 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-50538819-0f6a-44dc-805a-cf7e71ba03f3 req-16d6418b-223e-45f3-8b34-c3c224d4efd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42694b52-21ac-48ab-9fbb-de90c7bcb478", "name": "network-vif-deleted", "tag": "03ae95f6-837e-497f-b140-a8121c8bc611"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:14:59.374998 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:14:59.374998 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:14:59.393796 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-50538819-0f6a-44dc-805a-cf7e71ba03f3 req-16d6418b-223e-45f3-8b34-c3c224d4efd3 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:59.394672 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-50538819-0f6a-44dc-805a-cf7e71ba03f3 req-16d6418b-223e-45f3-8b34-c3c224d4efd3 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:59.451532 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-50538819-0f6a-44dc-805a-cf7e71ba03f3 req-16d6418b-223e-45f3-8b34-c3c224d4efd3 service nova] Creating event network-vif-deleted:03ae95f6-837e-497f-b140-a8121c8bc611 for instance 42694b52-21ac-48ab-9fbb-de90c7bcb478 on hv-cinder-81803 Dec 18 03:14:59.472335 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-50538819-0f6a-44dc-805a-cf7e71ba03f3 req-16d6418b-223e-45f3-8b34-c3c224d4efd3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112128 Dec 18 03:14:59.473450 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 220/452] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:14:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:14:59.520220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:14:59.521505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:14:59.528353 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:59.529112 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:59.530194 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:14:59.530703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:14:59.797165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:59.808955 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:59.811352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:14:59.812786 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-dabbcfd0-0ea1-40f5-bc1b-b457635f959f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.296209 Dec 18 03:14:59.813367 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 233/453] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:14:59 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:00.101234 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f55c48fa-2cba-4fcf-8dbc-4d77aaaa27dc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:00.101974 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f55c48fa-2cba-4fcf-8dbc-4d77aaaa27dc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:00.111694 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f55c48fa-2cba-4fcf-8dbc-4d77aaaa27dc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.113201 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f55c48fa-2cba-4fcf-8dbc-4d77aaaa27dc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:00.114921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f55c48fa-2cba-4fcf-8dbc-4d77aaaa27dc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.116555 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f55c48fa-2cba-4fcf-8dbc-4d77aaaa27dc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:00.205191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-143e431c-a6dc-44f4-be4f-e128308b6c63 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:00.206726 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-143e431c-a6dc-44f4-be4f-e128308b6c63 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 42694b52-21ac-48ab-9fbb-de90c7bcb478] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:00.214871 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-143e431c-a6dc-44f4-be4f-e128308b6c63 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.215688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-143e431c-a6dc-44f4-be4f-e128308b6c63 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:00.216628 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-143e431c-a6dc-44f4-be4f-e128308b6c63 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.217455 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-143e431c-a6dc-44f4-be4f-e128308b6c63 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:00.235407 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-143e431c-a6dc-44f4-be4f-e128308b6c63 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] HTTP exception thrown: Instance 42694b52-21ac-48ab-9fbb-de90c7bcb478 could not be found. Dec 18 03:15:00.236215 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-143e431c-a6dc-44f4-be4f-e128308b6c63 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Returning 404 to user: Instance 42694b52-21ac-48ab-9fbb-de90c7bcb478 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:15:00.237311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-143e431c-a6dc-44f4-be4f-e128308b6c63 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478" status: 404 len: 111 microversion: 2.1 time: 0.036635 Dec 18 03:15:00.238444 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 234/454] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:00 2021] GET /compute/v2.1/servers/42694b52-21ac-48ab-9fbb-de90c7bcb478 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:15:00.246903 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5a4dfde4-2562-47fd-95f1-42f44e40a219 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:00.247649 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5a4dfde4-2562-47fd-95f1-42f44e40a219 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:00.255063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5a4dfde4-2562-47fd-95f1-42f44e40a219 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.255733 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5a4dfde4-2562-47fd-95f1-42f44e40a219 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:00.256725 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5a4dfde4-2562-47fd-95f1-42f44e40a219 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.257320 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5a4dfde4-2562-47fd-95f1-42f44e40a219 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:00.291514 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5a4dfde4-2562-47fd-95f1-42f44e40a219 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:15:00.305904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f55c48fa-2cba-4fcf-8dbc-4d77aaaa27dc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:00.323466 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f55c48fa-2cba-4fcf-8dbc-4d77aaaa27dc tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.227419 Dec 18 03:15:00.324175 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 221/455] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:00 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:00.381064 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5a4dfde4-2562-47fd-95f1-42f44e40a219 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "DELETE /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 204 len: 0 microversion: 2.1 time: 0.137805 Dec 18 03:15:00.382139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 235/456] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:15:00 2021] DELETE /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:15:00.390053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6a028701-303b-430c-bba0-f13e63784dd6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:00.390964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6a028701-303b-430c-bba0-f13e63784dd6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:00.408003 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6a028701-303b-430c-bba0-f13e63784dd6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.408761 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6a028701-303b-430c-bba0-f13e63784dd6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:00.409965 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6a028701-303b-430c-bba0-f13e63784dd6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.410575 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6a028701-303b-430c-bba0-f13e63784dd6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:00.550815 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-6a028701-303b-430c-bba0-f13e63784dd6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:00.559907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6a028701-303b-430c-bba0-f13e63784dd6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.173731 Dec 18 03:15:00.560515 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 222/457] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:00 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:00.834375 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:00.835122 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:00.842797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.843360 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:00.844619 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:00.845182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:01.018513 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:01.027381 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:01.028891 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:01.030068 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7c87f8a6-7ad4-42cb-b0b7-5afdcddebf0e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.201247 Dec 18 03:15:01.030821 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 236/458] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:00 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:01.340061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c8c576fa-a854-4fc8-a1c5-916b8633de7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:01.340663 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c8c576fa-a854-4fc8-a1c5-916b8633de7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:01.347107 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8c576fa-a854-4fc8-a1c5-916b8633de7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:01.347551 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8c576fa-a854-4fc8-a1c5-916b8633de7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:01.348337 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8c576fa-a854-4fc8-a1c5-916b8633de7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:01.348895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8c576fa-a854-4fc8-a1c5-916b8633de7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:01.504757 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c8c576fa-a854-4fc8-a1c5-916b8633de7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:01.512580 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c8c576fa-a854-4fc8-a1c5-916b8633de7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.176165 Dec 18 03:15:01.513147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 223/459] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:01 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:01.578392 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c423d003-157a-4ad5-8022-f576f6918efe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:01.579258 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c423d003-157a-4ad5-8022-f576f6918efe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:01.588257 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c423d003-157a-4ad5-8022-f576f6918efe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:01.588805 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c423d003-157a-4ad5-8022-f576f6918efe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:01.589803 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c423d003-157a-4ad5-8022-f576f6918efe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:01.590210 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c423d003-157a-4ad5-8022-f576f6918efe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:01.729089 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c423d003-157a-4ad5-8022-f576f6918efe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:01.737462 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c423d003-157a-4ad5-8022-f576f6918efe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.162750 Dec 18 03:15:01.738068 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 237/460] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:01 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:02.048031 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:02.048668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:02.056533 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:02.057326 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:02.058146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:02.058645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:02.192114 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:02.200228 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:02.201734 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:02.202847 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f61961f7-6152-4b05-910b-2542791c322e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.158485 Dec 18 03:15:02.203394 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 224/461] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:02 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:02.529690 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-60ad6e55-2f05-4a77-bf75-839aa81b9320 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:02.530229 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-60ad6e55-2f05-4a77-bf75-839aa81b9320 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:02.536179 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-60ad6e55-2f05-4a77-bf75-839aa81b9320 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:02.536667 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-60ad6e55-2f05-4a77-bf75-839aa81b9320 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:02.538094 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-60ad6e55-2f05-4a77-bf75-839aa81b9320 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:02.538518 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-60ad6e55-2f05-4a77-bf75-839aa81b9320 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:02.663711 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-60ad6e55-2f05-4a77-bf75-839aa81b9320 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:02.670937 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-60ad6e55-2f05-4a77-bf75-839aa81b9320 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.144916 Dec 18 03:15:02.671494 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 238/462] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:02 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:02.754591 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-42791432-e427-486a-b3cc-5f9d319cdbcd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:02.755203 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-42791432-e427-486a-b3cc-5f9d319cdbcd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:02.762172 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-42791432-e427-486a-b3cc-5f9d319cdbcd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:02.762620 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-42791432-e427-486a-b3cc-5f9d319cdbcd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:02.763389 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-42791432-e427-486a-b3cc-5f9d319cdbcd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:02.763817 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-42791432-e427-486a-b3cc-5f9d319cdbcd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:02.891603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-42791432-e427-486a-b3cc-5f9d319cdbcd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:02.899582 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-42791432-e427-486a-b3cc-5f9d319cdbcd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.148553 Dec 18 03:15:02.900138 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 225/463] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:02 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:03.220587 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:03.221183 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:03.227336 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:03.227780 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:03.228545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:03.228974 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:03.358097 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:03.366835 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:03.368313 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:03.369456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-12ff020b-a584-437f-84f7-ec7e892dd4f1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.152520 Dec 18 03:15:03.370044 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 239/464] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:03 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:03.687494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d91809ee-87d1-43ff-9fab-81663e2af4ed tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:03.688057 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d91809ee-87d1-43ff-9fab-81663e2af4ed tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:03.694022 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d91809ee-87d1-43ff-9fab-81663e2af4ed tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:03.694470 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d91809ee-87d1-43ff-9fab-81663e2af4ed tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:03.695245 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d91809ee-87d1-43ff-9fab-81663e2af4ed tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:03.695930 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d91809ee-87d1-43ff-9fab-81663e2af4ed tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:03.845812 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d91809ee-87d1-43ff-9fab-81663e2af4ed tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:03.853697 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d91809ee-87d1-43ff-9fab-81663e2af4ed tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.169775 Dec 18 03:15:03.854269 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 226/465] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:03 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:03.916282 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-fb645c13-84b5-4201-ac19-d9d22fdbfbc8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:03.916885 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-fb645c13-84b5-4201-ac19-d9d22fdbfbc8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:03.923518 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fb645c13-84b5-4201-ac19-d9d22fdbfbc8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:03.924103 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fb645c13-84b5-4201-ac19-d9d22fdbfbc8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:03.924779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fb645c13-84b5-4201-ac19-d9d22fdbfbc8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:03.925214 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fb645c13-84b5-4201-ac19-d9d22fdbfbc8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:04.140604 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fb645c13-84b5-4201-ac19-d9d22fdbfbc8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:04.155597 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-fb645c13-84b5-4201-ac19-d9d22fdbfbc8 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.243177 Dec 18 03:15:04.159582 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 240/466] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:03 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:04.388202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:04.389341 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:04.396111 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:04.397514 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:04.399279 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:04.400072 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:04.706346 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:04.720145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:04.721720 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:04.722931 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f497f062-9f66-485e-831b-f175a8c8be35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.338464 Dec 18 03:15:04.745916 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 227/467] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:04 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:04.871715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d7d753f2-bccd-4631-919e-102087d0ae3e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:04.872364 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d7d753f2-bccd-4631-919e-102087d0ae3e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:04.883816 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d7d753f2-bccd-4631-919e-102087d0ae3e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:04.884242 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d7d753f2-bccd-4631-919e-102087d0ae3e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:04.885188 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d7d753f2-bccd-4631-919e-102087d0ae3e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:04.885646 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d7d753f2-bccd-4631-919e-102087d0ae3e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:05.144809 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d7d753f2-bccd-4631-919e-102087d0ae3e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:05.154480 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d7d753f2-bccd-4631-919e-102087d0ae3e tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.286774 Dec 18 03:15:05.176936 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a1e8f9ea-b71d-46fd-873e-c39341478310 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:05.177973 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 241/468] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:04 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:05.178663 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a1e8f9ea-b71d-46fd-873e-c39341478310 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:05.187864 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a1e8f9ea-b71d-46fd-873e-c39341478310 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:05.189346 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a1e8f9ea-b71d-46fd-873e-c39341478310 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:05.190427 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a1e8f9ea-b71d-46fd-873e-c39341478310 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:05.191314 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a1e8f9ea-b71d-46fd-873e-c39341478310 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:05.536551 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a1e8f9ea-b71d-46fd-873e-c39341478310 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:05.544990 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a1e8f9ea-b71d-46fd-873e-c39341478310 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.372628 Dec 18 03:15:05.545663 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 228/469] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:05 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:05.742969 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:05.744106 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:05.750058 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:05.750711 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:05.751667 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:05.752095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:05.930660 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:05.942704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:05.945060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:05.946689 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4ed50a0e-8ce8-4209-aa59-f91fc3f7a71c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.207745 Dec 18 03:15:05.947582 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 242/470] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:05 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:06.173156 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-655764c7-078e-4352-81f8-9dd169fa14ac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:06.173861 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-655764c7-078e-4352-81f8-9dd169fa14ac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:06.188056 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-655764c7-078e-4352-81f8-9dd169fa14ac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:06.189390 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-655764c7-078e-4352-81f8-9dd169fa14ac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:06.190348 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-655764c7-078e-4352-81f8-9dd169fa14ac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:06.190902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-655764c7-078e-4352-81f8-9dd169fa14ac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:06.418014 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-655764c7-078e-4352-81f8-9dd169fa14ac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:06.426558 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-655764c7-078e-4352-81f8-9dd169fa14ac tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.257086 Dec 18 03:15:06.428296 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 229/471] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:06 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:06.562720 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b985e9c9-3cf1-45e6-aad4-c03228551110 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:06.564293 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b985e9c9-3cf1-45e6-aad4-c03228551110 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:06.571711 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b985e9c9-3cf1-45e6-aad4-c03228551110 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:06.572760 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b985e9c9-3cf1-45e6-aad4-c03228551110 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:06.574046 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b985e9c9-3cf1-45e6-aad4-c03228551110 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:06.574687 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b985e9c9-3cf1-45e6-aad4-c03228551110 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:06.738710 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b985e9c9-3cf1-45e6-aad4-c03228551110 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:06.749716 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b985e9c9-3cf1-45e6-aad4-c03228551110 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.190931 Dec 18 03:15:06.750897 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 243/472] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:06 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:06.966000 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:06.967433 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:06.977323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:06.978717 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:06.979707 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:06.980576 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:07.160583 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:07.177783 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:07.179526 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:07.180708 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-17afe3e2-474c-43bf-b47e-96029dfd4210 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.219610 Dec 18 03:15:07.181337 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 230/473] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:06 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:07.446006 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5e5f9033-6d6f-42e1-8a3d-b056b58941c7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:07.446935 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5e5f9033-6d6f-42e1-8a3d-b056b58941c7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:07.453868 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5e5f9033-6d6f-42e1-8a3d-b056b58941c7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:07.454774 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5e5f9033-6d6f-42e1-8a3d-b056b58941c7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:07.455732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5e5f9033-6d6f-42e1-8a3d-b056b58941c7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:07.456412 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5e5f9033-6d6f-42e1-8a3d-b056b58941c7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:07.657613 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5e5f9033-6d6f-42e1-8a3d-b056b58941c7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:07.670047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5e5f9033-6d6f-42e1-8a3d-b056b58941c7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.227354 Dec 18 03:15:07.681246 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 244/474] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:07 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:07.767457 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-23f4ac4a-5074-4c1a-94f5-1d732dce9fdd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:07.768832 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-23f4ac4a-5074-4c1a-94f5-1d732dce9fdd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:07.781723 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23f4ac4a-5074-4c1a-94f5-1d732dce9fdd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:07.782688 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23f4ac4a-5074-4c1a-94f5-1d732dce9fdd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:07.783860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23f4ac4a-5074-4c1a-94f5-1d732dce9fdd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:07.784536 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23f4ac4a-5074-4c1a-94f5-1d732dce9fdd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:07.970733 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-23f4ac4a-5074-4c1a-94f5-1d732dce9fdd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:07.985889 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-23f4ac4a-5074-4c1a-94f5-1d732dce9fdd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.217974 Dec 18 03:15:07.990668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 231/475] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:07 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:08.200330 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:08.200873 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:08.207314 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:08.208047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:08.209639 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:08.210238 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:08.404723 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:08.422409 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:08.423978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:08.425220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7db24357-2640-4ad1-8923-af7b8b1db856 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.229751 Dec 18 03:15:08.433663 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 245/476] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:08 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:08.687905 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8c76ddd4-3c3e-4041-96e3-b5fe50ec76e9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:08.688947 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8c76ddd4-3c3e-4041-96e3-b5fe50ec76e9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:08.705181 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c76ddd4-3c3e-4041-96e3-b5fe50ec76e9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:08.706036 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c76ddd4-3c3e-4041-96e3-b5fe50ec76e9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:08.707402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c76ddd4-3c3e-4041-96e3-b5fe50ec76e9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:08.708062 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c76ddd4-3c3e-4041-96e3-b5fe50ec76e9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:08.914612 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8c76ddd4-3c3e-4041-96e3-b5fe50ec76e9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:08.933884 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8c76ddd4-3c3e-4041-96e3-b5fe50ec76e9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.249316 Dec 18 03:15:08.934720 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 232/477] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:08 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:09.004220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e8dd06d6-3dc3-4f75-9e68-120664aca904 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:09.004833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e8dd06d6-3dc3-4f75-9e68-120664aca904 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:09.012277 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8dd06d6-3dc3-4f75-9e68-120664aca904 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:09.012725 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8dd06d6-3dc3-4f75-9e68-120664aca904 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:09.013707 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8dd06d6-3dc3-4f75-9e68-120664aca904 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:09.014149 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8dd06d6-3dc3-4f75-9e68-120664aca904 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:09.200995 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e8dd06d6-3dc3-4f75-9e68-120664aca904 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:09.210201 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e8dd06d6-3dc3-4f75-9e68-120664aca904 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.214036 Dec 18 03:15:09.219815 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 246/478] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:08 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:09.444942 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:09.445581 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:09.451834 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:09.452330 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:09.453043 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:09.453478 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:09.623991 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:09.635349 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:09.637192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:09.638603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7b39a5eb-8480-4ded-8f1d-d7b40260ca57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.197428 Dec 18 03:15:09.653349 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 233/479] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:09 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:09.956951 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-473f3d0a-b559-4bec-9850-a1e5d1cae2ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:09.957569 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-473f3d0a-b559-4bec-9850-a1e5d1cae2ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:09.965195 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-473f3d0a-b559-4bec-9850-a1e5d1cae2ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:09.967345 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-473f3d0a-b559-4bec-9850-a1e5d1cae2ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:09.968157 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-473f3d0a-b559-4bec-9850-a1e5d1cae2ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:09.968597 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-473f3d0a-b559-4bec-9850-a1e5d1cae2ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:10.142361 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-473f3d0a-b559-4bec-9850-a1e5d1cae2ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:10.151925 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-473f3d0a-b559-4bec-9850-a1e5d1cae2ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.199213 Dec 18 03:15:10.154603 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 247/480] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:09 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:10.227907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7a348cfa-ee5f-450d-ad4c-92cde52f0f06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:10.228568 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7a348cfa-ee5f-450d-ad4c-92cde52f0f06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:10.360551 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7a348cfa-ee5f-450d-ad4c-92cde52f0f06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:10.360551 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7a348cfa-ee5f-450d-ad4c-92cde52f0f06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:10.360551 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7a348cfa-ee5f-450d-ad4c-92cde52f0f06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:10.360551 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7a348cfa-ee5f-450d-ad4c-92cde52f0f06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:10.509089 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7a348cfa-ee5f-450d-ad4c-92cde52f0f06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:10.517419 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7a348cfa-ee5f-450d-ad4c-92cde52f0f06 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.294183 Dec 18 03:15:10.539094 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 234/481] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:10 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:10.664171 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:10.664747 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:10.675488 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:10.675936 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:10.676733 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:10.680709 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:10.920194 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:10.930410 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:10.931903 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:10.933075 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c68d2210-5761-4ffa-a225-0b30e10ee65a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.276860 Dec 18 03:15:10.945060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 248/482] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:10 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:11.168377 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-10d14df4-fe06-426a-828a-de442943f165 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:11.169089 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-10d14df4-fe06-426a-828a-de442943f165 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:11.198769 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-10d14df4-fe06-426a-828a-de442943f165 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:11.202892 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-10d14df4-fe06-426a-828a-de442943f165 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:11.206924 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-10d14df4-fe06-426a-828a-de442943f165 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:11.210896 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-10d14df4-fe06-426a-828a-de442943f165 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:11.527763 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-10d14df4-fe06-426a-828a-de442943f165 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:11.531391 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-10d14df4-fe06-426a-828a-de442943f165 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.366724 Dec 18 03:15:11.532847 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 235/483] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:11 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:11.546792 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6845b91f-8963-46e9-ac46-febb17324022 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:11.548202 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6845b91f-8963-46e9-ac46-febb17324022 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:11.555402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6845b91f-8963-46e9-ac46-febb17324022 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:11.556562 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6845b91f-8963-46e9-ac46-febb17324022 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:11.556688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6845b91f-8963-46e9-ac46-febb17324022 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:11.557036 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6845b91f-8963-46e9-ac46-febb17324022 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:11.750270 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6845b91f-8963-46e9-ac46-febb17324022 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:11.758941 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6845b91f-8963-46e9-ac46-febb17324022 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.216050 Dec 18 03:15:11.762258 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 249/484] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:11 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:11.952637 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:11.953289 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:11.964943 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:11.965411 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:11.966923 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:11.968781 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:12.164980 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:12.175303 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:12.177796 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:12.179093 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3834abc0-0087-4b78-a987-30fc2bc92d86 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.230192 Dec 18 03:15:12.190138 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 236/485] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:11 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:12.550637 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a41c9238-8ddc-4add-8871-ad59ed0cd7e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:12.551894 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a41c9238-8ddc-4add-8871-ad59ed0cd7e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:12.558962 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a41c9238-8ddc-4add-8871-ad59ed0cd7e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:12.559425 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a41c9238-8ddc-4add-8871-ad59ed0cd7e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:12.560203 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a41c9238-8ddc-4add-8871-ad59ed0cd7e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:12.560630 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a41c9238-8ddc-4add-8871-ad59ed0cd7e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:12.712510 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a41c9238-8ddc-4add-8871-ad59ed0cd7e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:12.720771 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a41c9238-8ddc-4add-8871-ad59ed0cd7e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.174912 Dec 18 03:15:12.721412 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 250/486] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:12 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:12.777755 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8b0ed1a6-4ecf-46ae-8729-c0bd772a4143 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:12.778359 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8b0ed1a6-4ecf-46ae-8729-c0bd772a4143 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:12.784681 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8b0ed1a6-4ecf-46ae-8729-c0bd772a4143 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:12.785129 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8b0ed1a6-4ecf-46ae-8729-c0bd772a4143 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:12.785930 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8b0ed1a6-4ecf-46ae-8729-c0bd772a4143 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:12.786589 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8b0ed1a6-4ecf-46ae-8729-c0bd772a4143 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:12.931446 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8b0ed1a6-4ecf-46ae-8729-c0bd772a4143 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:12.939689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8b0ed1a6-4ecf-46ae-8729-c0bd772a4143 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.165474 Dec 18 03:15:12.940264 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 237/487] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:12 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:13.199073 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:13.199610 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:13.205674 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:13.206138 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:13.206968 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:13.207402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:13.338732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:13.346838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:13.348298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:13.349989 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-baeff112-1ee6-4a5c-8819-2326536a1eed tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.154739 Dec 18 03:15:13.350534 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 251/488] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:13 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:13.737183 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2c23621a-d818-4ca5-af0c-ec61712bbf51 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:13.737820 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2c23621a-d818-4ca5-af0c-ec61712bbf51 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:13.743764 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2c23621a-d818-4ca5-af0c-ec61712bbf51 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:13.744208 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2c23621a-d818-4ca5-af0c-ec61712bbf51 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:13.744974 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2c23621a-d818-4ca5-af0c-ec61712bbf51 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:13.745406 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2c23621a-d818-4ca5-af0c-ec61712bbf51 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:13.881781 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2c23621a-d818-4ca5-af0c-ec61712bbf51 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:13.889004 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2c23621a-d818-4ca5-af0c-ec61712bbf51 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.155398 Dec 18 03:15:13.899260 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 238/489] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:13 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:13.957464 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-93b22125-16fd-4b00-82e9-4c9fc6380d24 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:13.958772 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-93b22125-16fd-4b00-82e9-4c9fc6380d24 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:13.966442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-93b22125-16fd-4b00-82e9-4c9fc6380d24 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:13.967184 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-93b22125-16fd-4b00-82e9-4c9fc6380d24 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:13.968320 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-93b22125-16fd-4b00-82e9-4c9fc6380d24 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:13.969055 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-93b22125-16fd-4b00-82e9-4c9fc6380d24 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:14.107474 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-93b22125-16fd-4b00-82e9-4c9fc6380d24 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:14.115649 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-93b22125-16fd-4b00-82e9-4c9fc6380d24 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.161820 Dec 18 03:15:14.116216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 252/490] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:13 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:14.368519 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:14.369373 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:14.375582 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:14.376108 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:14.377116 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:14.377634 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:14.514902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:14.524160 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:14.525819 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:14.527032 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b48588d0-32ca-450d-ba3c-639d9539bdd1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.162723 Dec 18 03:15:14.527592 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 239/491] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:14 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:14.906293 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-eea7e8f4-0543-4c98-9c1a-03879c60d49a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:14.906895 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-eea7e8f4-0543-4c98-9c1a-03879c60d49a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:14.913366 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eea7e8f4-0543-4c98-9c1a-03879c60d49a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:14.913839 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eea7e8f4-0543-4c98-9c1a-03879c60d49a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:14.914621 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eea7e8f4-0543-4c98-9c1a-03879c60d49a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:14.915050 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eea7e8f4-0543-4c98-9c1a-03879c60d49a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:15.056785 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-eea7e8f4-0543-4c98-9c1a-03879c60d49a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:15.065920 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-eea7e8f4-0543-4c98-9c1a-03879c60d49a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.162932 Dec 18 03:15:15.066586 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 253/492] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:14 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:15.135040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bd240eab-da50-4703-947c-41e31f57d6a9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:15.136921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bd240eab-da50-4703-947c-41e31f57d6a9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:15.143089 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bd240eab-da50-4703-947c-41e31f57d6a9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:15.143622 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bd240eab-da50-4703-947c-41e31f57d6a9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:15.144417 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bd240eab-da50-4703-947c-41e31f57d6a9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:15.144853 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bd240eab-da50-4703-947c-41e31f57d6a9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:15.282059 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bd240eab-da50-4703-947c-41e31f57d6a9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:15.290147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bd240eab-da50-4703-947c-41e31f57d6a9 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.161049 Dec 18 03:15:15.290721 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 240/493] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:15 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:15.545447 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:15.546450 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:15.554549 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:15.555371 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:15.556405 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:15.556937 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:15.695254 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:15.703625 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:15.705084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:15.706248 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a900cbdd-77ef-45d6-b46b-437ae22f5b15 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.164558 Dec 18 03:15:15.706796 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 254/494] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:15 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:16.086269 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ac25d0a8-a010-4753-9740-52954642e5f0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:16.086864 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ac25d0a8-a010-4753-9740-52954642e5f0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:16.093019 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac25d0a8-a010-4753-9740-52954642e5f0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:16.093517 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac25d0a8-a010-4753-9740-52954642e5f0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:16.094470 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac25d0a8-a010-4753-9740-52954642e5f0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:16.094910 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac25d0a8-a010-4753-9740-52954642e5f0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:16.238782 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ac25d0a8-a010-4753-9740-52954642e5f0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:16.246110 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ac25d0a8-a010-4753-9740-52954642e5f0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.164384 Dec 18 03:15:16.246679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 241/495] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:16 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:16.306830 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9d3e8a2b-27f8-4a82-96c1-f1452ccaa6bd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:16.307459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9d3e8a2b-27f8-4a82-96c1-f1452ccaa6bd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:16.313986 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a2b-27f8-4a82-96c1-f1452ccaa6bd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:16.314437 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a2b-27f8-4a82-96c1-f1452ccaa6bd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:16.315442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a2b-27f8-4a82-96c1-f1452ccaa6bd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:16.315877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9d3e8a2b-27f8-4a82-96c1-f1452ccaa6bd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:16.455736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9d3e8a2b-27f8-4a82-96c1-f1452ccaa6bd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:16.464030 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9d3e8a2b-27f8-4a82-96c1-f1452ccaa6bd tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.161043 Dec 18 03:15:16.464594 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 255/496] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:16 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:16.724849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:16.725478 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:16.731628 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:16.732071 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:16.732895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:16.733326 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:16.865381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:16.874144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:16.875620 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:16.876778 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7e6b0f2a-4a61-4e32-b558-74ab929b0378 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.155707 Dec 18 03:15:16.877328 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 242/497] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:16 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:17.263404 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-097f19a6-e617-4e70-b029-4e428b9f5afe tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:17.264002 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-097f19a6-e617-4e70-b029-4e428b9f5afe tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:17.269862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-097f19a6-e617-4e70-b029-4e428b9f5afe tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:17.270303 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-097f19a6-e617-4e70-b029-4e428b9f5afe tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:17.271227 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-097f19a6-e617-4e70-b029-4e428b9f5afe tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:17.271654 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-097f19a6-e617-4e70-b029-4e428b9f5afe tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:17.405846 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-097f19a6-e617-4e70-b029-4e428b9f5afe tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:17.414376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-097f19a6-e617-4e70-b029-4e428b9f5afe tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.154670 Dec 18 03:15:17.414955 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 256/498] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:17 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:17.480940 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7f88b913-87b6-4145-9dac-61b040198acf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:17.481527 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7f88b913-87b6-4145-9dac-61b040198acf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:17.487892 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7f88b913-87b6-4145-9dac-61b040198acf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:17.488334 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7f88b913-87b6-4145-9dac-61b040198acf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:17.489115 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7f88b913-87b6-4145-9dac-61b040198acf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:17.489547 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7f88b913-87b6-4145-9dac-61b040198acf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:17.624480 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7f88b913-87b6-4145-9dac-61b040198acf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:17.632063 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7f88b913-87b6-4145-9dac-61b040198acf tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.155077 Dec 18 03:15:17.632695 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 243/499] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:17 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:17.898368 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:17.898961 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:17.904672 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:17.905108 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:17.905902 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:17.906324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:18.039528 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:18.047818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:18.049300 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:18.050602 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e1dd7558-40e6-4868-9f24-61e73482ea20 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.156337 Dec 18 03:15:18.051031 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 257/500] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:17 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:18.430643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1b6e8fa9-701f-476b-acbb-48a1f3f2e294 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:18.431323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1b6e8fa9-701f-476b-acbb-48a1f3f2e294 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:18.437687 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1b6e8fa9-701f-476b-acbb-48a1f3f2e294 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:18.438159 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1b6e8fa9-701f-476b-acbb-48a1f3f2e294 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:18.439134 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1b6e8fa9-701f-476b-acbb-48a1f3f2e294 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:18.439572 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1b6e8fa9-701f-476b-acbb-48a1f3f2e294 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:18.571745 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1b6e8fa9-701f-476b-acbb-48a1f3f2e294 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:18.579021 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1b6e8fa9-701f-476b-acbb-48a1f3f2e294 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.152565 Dec 18 03:15:18.579583 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 244/501] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:18 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:18.648764 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-67bf14c9-bebb-47ec-a05d-84180fbf7181 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:18.649319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-67bf14c9-bebb-47ec-a05d-84180fbf7181 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:18.655596 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67bf14c9-bebb-47ec-a05d-84180fbf7181 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:18.656040 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67bf14c9-bebb-47ec-a05d-84180fbf7181 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:18.656809 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67bf14c9-bebb-47ec-a05d-84180fbf7181 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:18.657240 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67bf14c9-bebb-47ec-a05d-84180fbf7181 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:18.784604 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-67bf14c9-bebb-47ec-a05d-84180fbf7181 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:18.791916 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-67bf14c9-bebb-47ec-a05d-84180fbf7181 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1514 microversion: 2.1 time: 0.147573 Dec 18 03:15:18.792504 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 258/502] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:18 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:19.069407 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:19.070036 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:19.076146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:19.076587 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:19.077372 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:19.077832 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:19.211395 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:19.219889 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:19.221381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:19.222550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4fa4ffa4-0cad-4826-bfb6-813054128330 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.157535 Dec 18 03:15:19.223109 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 245/503] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:19 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:19.547319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-695a70fe-cb52-45b0-9a99-4a4b3649828b req-c184ba43-0c6d-45d7-9244-2259a5a4d79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c1697d-abd6-44f6-b11e-e6407b595fa9", "name": "network-vif-deleted", "tag": "01a67308-4fa3-4c17-9106-2b102610d2fe"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:19.550824 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:15:19.550824 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:15:19.569223 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-695a70fe-cb52-45b0-9a99-4a4b3649828b req-c184ba43-0c6d-45d7-9244-2259a5a4d79a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:19.570003 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-695a70fe-cb52-45b0-9a99-4a4b3649828b req-c184ba43-0c6d-45d7-9244-2259a5a4d79a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:19.590623 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-695a70fe-cb52-45b0-9a99-4a4b3649828b req-c184ba43-0c6d-45d7-9244-2259a5a4d79a service nova] Creating event network-vif-deleted:01a67308-4fa3-4c17-9106-2b102610d2fe for instance 49c1697d-abd6-44f6-b11e-e6407b595fa9 on hv-cinder-81803 Dec 18 03:15:19.597154 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-38efb51c-34be-402e-b70c-99bc94c28c96 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:19.598068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-38efb51c-34be-402e-b70c-99bc94c28c96 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:19.613060 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-38efb51c-34be-402e-b70c-99bc94c28c96 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:19.613668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-38efb51c-34be-402e-b70c-99bc94c28c96 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:19.617464 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-38efb51c-34be-402e-b70c-99bc94c28c96 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:19.618148 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-38efb51c-34be-402e-b70c-99bc94c28c96 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:19.651971 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-695a70fe-cb52-45b0-9a99-4a4b3649828b req-c184ba43-0c6d-45d7-9244-2259a5a4d79a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106709 Dec 18 03:15:19.655982 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 259/504] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:15:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:15:19.812355 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:19.813061 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:19.822100 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:19.822482 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:19.823270 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:19.824464 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:19.862495 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:19.862946 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:19.863403 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lazy-loading 'fault' on Instance uuid 49c1697d-abd6-44f6-b11e-e6407b595fa9 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:15:19.876079 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-38efb51c-34be-402e-b70c-99bc94c28c96 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:19.891446 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-38efb51c-34be-402e-b70c-99bc94c28c96 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.298611 Dec 18 03:15:19.892020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 246/505] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:19 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:19.915777 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:19.922926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1a9e128a-70d6-4f5f-9ba8-bd7e149b4f11 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 200 len: 1307 microversion: 2.1 time: 0.115111 Dec 18 03:15:19.923484 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 260/506] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:19 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:20.244099 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:20.244703 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:20.250878 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:20.251322 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:20.252100 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:20.252535 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:20.414891 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:20.424433 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:20.426232 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:20.428737 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bbf09e28-3e16-4e20-94a6-4e65f7bbd108 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.188258 Dec 18 03:15:20.429483 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 247/507] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:20 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:20.908910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-366f1d1b-4ab2-487c-aab4-b5d8b511b2dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:20.909444 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-366f1d1b-4ab2-487c-aab4-b5d8b511b2dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:20.915753 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-366f1d1b-4ab2-487c-aab4-b5d8b511b2dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:20.916197 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-366f1d1b-4ab2-487c-aab4-b5d8b511b2dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:20.916975 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-366f1d1b-4ab2-487c-aab4-b5d8b511b2dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:20.917409 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-366f1d1b-4ab2-487c-aab4-b5d8b511b2dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:20.939654 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cc3c37ca-9722-4d5d-a28e-ab66aeabbc5c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:20.940399 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cc3c37ca-9722-4d5d-a28e-ab66aeabbc5c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 49c1697d-abd6-44f6-b11e-e6407b595fa9] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:20.946838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc3c37ca-9722-4d5d-a28e-ab66aeabbc5c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:20.947305 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc3c37ca-9722-4d5d-a28e-ab66aeabbc5c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:20.948073 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc3c37ca-9722-4d5d-a28e-ab66aeabbc5c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:20.948702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc3c37ca-9722-4d5d-a28e-ab66aeabbc5c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:20.962391 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-cc3c37ca-9722-4d5d-a28e-ab66aeabbc5c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] HTTP exception thrown: Instance 49c1697d-abd6-44f6-b11e-e6407b595fa9 could not be found. Dec 18 03:15:20.962973 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cc3c37ca-9722-4d5d-a28e-ab66aeabbc5c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Returning 404 to user: Instance 49c1697d-abd6-44f6-b11e-e6407b595fa9 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:15:20.963790 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cc3c37ca-9722-4d5d-a28e-ab66aeabbc5c tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9" status: 404 len: 111 microversion: 2.1 time: 0.027748 Dec 18 03:15:20.964332 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 248/508] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:20 2021] GET /compute/v2.1/servers/49c1697d-abd6-44f6-b11e-e6407b595fa9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 03:15:21.058771 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-366f1d1b-4ab2-487c-aab4-b5d8b511b2dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:21.066851 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-366f1d1b-4ab2-487c-aab4-b5d8b511b2dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1500 microversion: 2.1 time: 0.161671 Dec 18 03:15:21.073682 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 261/509] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:20 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:21.083667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ff33211e-a775-4460-81f1-6027ea46f20a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e480d678-7b5e-4dab-abb4-d436fc0109df"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:21.084884 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ff33211e-a775-4460-81f1-6027ea46f20a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:21.090771 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ff33211e-a775-4460-81f1-6027ea46f20a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.091212 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ff33211e-a775-4460-81f1-6027ea46f20a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.091979 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ff33211e-a775-4460-81f1-6027ea46f20a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.092406 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ff33211e-a775-4460-81f1-6027ea46f20a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.116471 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-ff33211e-a775-4460-81f1-6027ea46f20a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] HTTP exception thrown: Cannot 'attach_volume' instance d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a while it is in vm_state rescued Dec 18 03:15:21.117043 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ff33211e-a775-4460-81f1-6027ea46f20a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Returning 409 to user: Cannot 'attach_volume' instance d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a while it is in vm_state rescued {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:15:21.117871 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ff33211e-a775-4460-81f1-6027ea46f20a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038679 Dec 18 03:15:21.118397 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 249/510] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:15:21 2021] POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 03:15:21.126724 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-901d8c29-9dc7-4279-bc2f-71ae15cd9566 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:21.127262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-901d8c29-9dc7-4279-bc2f-71ae15cd9566 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:21.133068 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-901d8c29-9dc7-4279-bc2f-71ae15cd9566 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.133509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-901d8c29-9dc7-4279-bc2f-71ae15cd9566 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.134334 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-901d8c29-9dc7-4279-bc2f-71ae15cd9566 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.135088 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-901d8c29-9dc7-4279-bc2f-71ae15cd9566 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.201346 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-901d8c29-9dc7-4279-bc2f-71ae15cd9566 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/action" status: 202 len: 0 microversion: 2.1 time: 0.077985 Dec 18 03:15:21.202296 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 262/511] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:15:21 2021] POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:15:21.210613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-12280ef4-d6b3-4058-91ee-9eb82aa7d109 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:21.211212 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-12280ef4-d6b3-4058-91ee-9eb82aa7d109 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:21.216879 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-12280ef4-d6b3-4058-91ee-9eb82aa7d109 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.217323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-12280ef4-d6b3-4058-91ee-9eb82aa7d109 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.218121 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-12280ef4-d6b3-4058-91ee-9eb82aa7d109 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.218564 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-12280ef4-d6b3-4058-91ee-9eb82aa7d109 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.362363 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-12280ef4-d6b3-4058-91ee-9eb82aa7d109 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:21.370095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-12280ef4-d6b3-4058-91ee-9eb82aa7d109 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1508 microversion: 2.1 time: 0.163541 Dec 18 03:15:21.370905 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 250/512] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:21 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:21.447374 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:21.448075 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:21.457376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.457376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.457376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.457376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.465007 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-507298011", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-412012440", "security_groups": [{"name": "tempest-secgroup-smoke-228218707"}], "block_device_mapping_v2": [{"uuid": "31505c61-9a79-400d-b2fe-0e7698aa5a6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "564be5c6-0032-4b6f-a63b-8fc0ef0d3621"}]}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:21.591121 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] validate_networks() for [('564be5c6-0032-4b6f-a63b-8fc0ef0d3621', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:15:21.693988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:21.703300 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:21.704833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:21.706039 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1b54b448-5fa6-4b1b-a18e-fce6ce4e818a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.263149 Dec 18 03:15:21.706653 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 263/513] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:21 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:21.712156 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5400c9a7-0456-4382-becc-ac0123d30a86 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:21.712576 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5400c9a7-0456-4382-becc-ac0123d30a86 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:21.718580 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5400c9a7-0456-4382-becc-ac0123d30a86 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.719028 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5400c9a7-0456-4382-becc-ac0123d30a86 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.719867 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5400c9a7-0456-4382-becc-ac0123d30a86 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:21.720305 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5400c9a7-0456-4382-becc-ac0123d30a86 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:21.806739 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-5400c9a7-0456-4382-becc-ac0123d30a86 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lazy-loading 'services' on Instance uuid c57492c3-936b-4bd6-a228-ea2828faae96 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:15:21.884956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5400c9a7-0456-4382-becc-ac0123d30a86 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96/os-volume_attachments/f40814b9-5aa6-4b71-802c-2d4bf1809f93" status: 202 len: 0 microversion: 2.1 time: 0.176909 Dec 18 03:15:21.886138 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 264/514] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:15:21 2021] DELETE /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96/os-volume_attachments/f40814b9-5aa6-4b71-802c-2d4bf1809f93 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:15:22.004373 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:15:22.005468 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:15:22.005776 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:15:22.006180 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:15:22.007043 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:15:22.017208 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.017790 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.018671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.019171 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.036521 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for project f7f34416462043419f27fc97d17ab2bb. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:15:22.040433 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for user fd2d51b351b44cdfb136d754ffdf3f0f and project f7f34416462043419f27fc97d17ab2bb. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:15:22.101248 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:15:22.101550 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d032271d-d49d-4f85-b4de-ed05ae2390dc tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:22.102242 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d032271d-d49d-4f85-b4de-ed05ae2390dc tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:22.103373 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31505c61-9a79-400d-b2fe-0e7698aa5a6b',volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:15:22.109773 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d032271d-d49d-4f85-b4de-ed05ae2390dc tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.110219 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d032271d-d49d-4f85-b4de-ed05ae2390dc tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.111019 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d032271d-d49d-4f85-b4de-ed05ae2390dc tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.111405 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d032271d-d49d-4f85-b4de-ed05ae2390dc tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.139746 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d032271d-d49d-4f85-b4de-ed05ae2390dc tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:15:22.220724 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d032271d-d49d-4f85-b4de-ed05ae2390dc tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 204 len: 0 microversion: 2.1 time: 0.124419 Dec 18 03:15:22.221308 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 265/515] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:15:22 2021] DELETE /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 03:15:22.227381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cd86b158-d29c-4a67-8798-ca6e4ea2e5b4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.768389 Dec 18 03:15:22.227948 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 251/516] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:15:21 2021] POST /compute/v2.1/servers => generated 405 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 03:15:22.235956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b5e1e0f6-f968-4f4a-a3d3-9327a14446d6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:22.236736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b5e1e0f6-f968-4f4a-a3d3-9327a14446d6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:22.240085 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6d601903-ea42-4ccd-b586-286dda450eb4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:22.240802 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6d601903-ea42-4ccd-b586-286dda450eb4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:22.244015 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b5e1e0f6-f968-4f4a-a3d3-9327a14446d6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.244633 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b5e1e0f6-f968-4f4a-a3d3-9327a14446d6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.245695 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b5e1e0f6-f968-4f4a-a3d3-9327a14446d6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.246339 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b5e1e0f6-f968-4f4a-a3d3-9327a14446d6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.301387 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-6d601903-ea42-4ccd-b586-286dda450eb4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:22.311344 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6d601903-ea42-4ccd-b586-286dda450eb4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1093 microversion: 2.1 time: 0.077282 Dec 18 03:15:22.311991 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 252/517] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:22 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:22.390627 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a61692c7-7073-4e5f-8fa5-0fe14e2a6063 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:22.391288 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a61692c7-7073-4e5f-8fa5-0fe14e2a6063 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:22.402926 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a61692c7-7073-4e5f-8fa5-0fe14e2a6063 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.402926 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a61692c7-7073-4e5f-8fa5-0fe14e2a6063 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.402926 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a61692c7-7073-4e5f-8fa5-0fe14e2a6063 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.402926 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a61692c7-7073-4e5f-8fa5-0fe14e2a6063 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.404529 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b5e1e0f6-f968-4f4a-a3d3-9327a14446d6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:22.414966 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b5e1e0f6-f968-4f4a-a3d3-9327a14446d6 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1515 microversion: 2.1 time: 0.188520 Dec 18 03:15:22.415773 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 266/518] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:22 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:22.598132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a61692c7-7073-4e5f-8fa5-0fe14e2a6063 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:22.610418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a61692c7-7073-4e5f-8fa5-0fe14e2a6063 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1508 microversion: 2.1 time: 0.223127 Dec 18 03:15:22.611115 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 253/519] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:22 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:22.727220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:22.729088 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:22.734633 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.735060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.736046 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:22.736630 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:22.912798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:22.921266 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:22.922790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:22.923944 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e04b4a26-6f22-44ab-a77d-c32184f844ba tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.201335 Dec 18 03:15:22.924498 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 267/520] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:22 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:15:23.327684 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cc80f58e-d784-4138-9869-c5a3df28ae47 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:23.328393 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cc80f58e-d784-4138-9869-c5a3df28ae47 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:23.335220 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc80f58e-d784-4138-9869-c5a3df28ae47 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:23.335659 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc80f58e-d784-4138-9869-c5a3df28ae47 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:23.336427 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc80f58e-d784-4138-9869-c5a3df28ae47 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:23.336851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cc80f58e-d784-4138-9869-c5a3df28ae47 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:23.399824 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-cc80f58e-d784-4138-9869-c5a3df28ae47 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:23.408038 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cc80f58e-d784-4138-9869-c5a3df28ae47 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1191 microversion: 2.1 time: 0.083878 Dec 18 03:15:23.417472 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 254/521] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:23 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:23.432573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a3511a47-4f6f-45c8-9546-56408d8536fe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:23.433282 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a3511a47-4f6f-45c8-9546-56408d8536fe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:23.440627 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a3511a47-4f6f-45c8-9546-56408d8536fe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:23.441364 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a3511a47-4f6f-45c8-9546-56408d8536fe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:23.443098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a3511a47-4f6f-45c8-9546-56408d8536fe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:23.443752 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a3511a47-4f6f-45c8-9546-56408d8536fe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:23.628150 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0bb44a6f-ee71-4fd9-a99f-b2584e3c89f3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:23.628837 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0bb44a6f-ee71-4fd9-a99f-b2584e3c89f3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:23.639232 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0bb44a6f-ee71-4fd9-a99f-b2584e3c89f3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:23.639763 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0bb44a6f-ee71-4fd9-a99f-b2584e3c89f3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:23.640611 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0bb44a6f-ee71-4fd9-a99f-b2584e3c89f3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:23.641111 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0bb44a6f-ee71-4fd9-a99f-b2584e3c89f3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:23.670396 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a3511a47-4f6f-45c8-9546-56408d8536fe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:23.679059 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a3511a47-4f6f-45c8-9546-56408d8536fe tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1515 microversion: 2.1 time: 0.250033 Dec 18 03:15:23.679703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 268/522] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:23 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:23.774562 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0bb44a6f-ee71-4fd9-a99f-b2584e3c89f3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:23.782508 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0bb44a6f-ee71-4fd9-a99f-b2584e3c89f3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1508 microversion: 2.1 time: 0.158429 Dec 18 03:15:23.783086 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 255/523] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:23 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:23.941948 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:23.942765 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:23.948827 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:23.949271 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:23.950080 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:23.950501 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.080020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b8b552fa-efd6-4b3c-88df-694c4ebd1a38 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:24.080607 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b8b552fa-efd6-4b3c-88df-694c4ebd1a38 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:24.087749 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b8b552fa-efd6-4b3c-88df-694c4ebd1a38 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.088197 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b8b552fa-efd6-4b3c-88df-694c4ebd1a38 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.088978 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b8b552fa-efd6-4b3c-88df-694c4ebd1a38 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.089408 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b8b552fa-efd6-4b3c-88df-694c4ebd1a38 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.114514 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b8b552fa-efd6-4b3c-88df-694c4ebd1a38 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Going to try to terminate instance {{(pid=116000) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:15:24.158411 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:24.169025 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:24.170577 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:24.171720 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-068cd244-249e-4d6c-b8c7-d77f8c43b175 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.233487 Dec 18 03:15:24.181828 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 269/524] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:23 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:24.192152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b8b552fa-efd6-4b3c-88df-694c4ebd1a38 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 204 len: 0 microversion: 2.1 time: 0.115350 Dec 18 03:15:24.193053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 256/525] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:15:24 2021] DELETE /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 03:15:24.200833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-aaf23016-a147-45e4-bc2e-db8597354e3d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:24.201437 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-aaf23016-a147-45e4-bc2e-db8597354e3d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:24.207348 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aaf23016-a147-45e4-bc2e-db8597354e3d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.208374 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aaf23016-a147-45e4-bc2e-db8597354e3d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.209245 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aaf23016-a147-45e4-bc2e-db8597354e3d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.209772 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aaf23016-a147-45e4-bc2e-db8597354e3d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.412910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-aaf23016-a147-45e4-bc2e-db8597354e3d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:24.423787 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-aaf23016-a147-45e4-bc2e-db8597354e3d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1513 microversion: 2.1 time: 0.226302 Dec 18 03:15:24.424834 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 270/526] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:24 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:24.427684 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-80f6d90d-73de-47f1-9270-9b689f0a3ba7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:24.429258 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-80f6d90d-73de-47f1-9270-9b689f0a3ba7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:24.446528 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-80f6d90d-73de-47f1-9270-9b689f0a3ba7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.447467 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-80f6d90d-73de-47f1-9270-9b689f0a3ba7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.448649 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-80f6d90d-73de-47f1-9270-9b689f0a3ba7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.449442 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-80f6d90d-73de-47f1-9270-9b689f0a3ba7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.642042 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-80f6d90d-73de-47f1-9270-9b689f0a3ba7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:24.650718 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-80f6d90d-73de-47f1-9270-9b689f0a3ba7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1276 microversion: 2.1 time: 0.230200 Dec 18 03:15:24.651433 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 257/527] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:24 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:24.696032 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3d41e146-343d-4e51-9c10-66dcc23b9f95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:24.696790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3d41e146-343d-4e51-9c10-66dcc23b9f95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:24.703176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d41e146-343d-4e51-9c10-66dcc23b9f95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.703691 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d41e146-343d-4e51-9c10-66dcc23b9f95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.704527 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d41e146-343d-4e51-9c10-66dcc23b9f95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.705053 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3d41e146-343d-4e51-9c10-66dcc23b9f95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.800688 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3ca4383c-a041-4a29-95df-7b36ade2ebf6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:24.801417 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3ca4383c-a041-4a29-95df-7b36ade2ebf6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:24.807785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ca4383c-a041-4a29-95df-7b36ade2ebf6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.808333 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ca4383c-a041-4a29-95df-7b36ade2ebf6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.809196 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ca4383c-a041-4a29-95df-7b36ade2ebf6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:24.809754 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ca4383c-a041-4a29-95df-7b36ade2ebf6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:24.922569 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3d41e146-343d-4e51-9c10-66dcc23b9f95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:24.930872 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3d41e146-343d-4e51-9c10-66dcc23b9f95 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1515 microversion: 2.1 time: 0.239043 Dec 18 03:15:24.931563 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 271/528] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:24 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:25.186936 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3ca4383c-a041-4a29-95df-7b36ade2ebf6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:25.190502 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:25.191227 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:25.197859 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.198375 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.199241 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.199763 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.200937 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3ca4383c-a041-4a29-95df-7b36ade2ebf6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1514 microversion: 2.1 time: 0.405379 Dec 18 03:15:25.201662 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 258/529] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:24 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:25.324008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-41ff15cb-a24f-4b71-aa74-6180983a2c0d req-4e73f15e-fb17-4c5f-aa5c-698d003074dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9e593b-0924-4c44-b1f2-e978a0a72025", "tag": "3c025ffb-e617-491c-82db-5bbcb6fa0c38"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:25.325780 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:15:25.325780 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:15:25.349353 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-41ff15cb-a24f-4b71-aa74-6180983a2c0d req-4e73f15e-fb17-4c5f-aa5c-698d003074dc service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.350055 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-41ff15cb-a24f-4b71-aa74-6180983a2c0d req-4e73f15e-fb17-4c5f-aa5c-698d003074dc service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.377132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-41ff15cb-a24f-4b71-aa74-6180983a2c0d req-4e73f15e-fb17-4c5f-aa5c-698d003074dc service nova] Creating event network-changed:3c025ffb-e617-491c-82db-5bbcb6fa0c38 for instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 on hv-cinder-81803 Dec 18 03:15:25.387228 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-41ff15cb-a24f-4b71-aa74-6180983a2c0d req-4e73f15e-fb17-4c5f-aa5c-698d003074dc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073633 Dec 18 03:15:25.388028 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 259/530] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:15:25.444788 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-be0eb97c-c106-4787-a577-25639ab0db56 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:25.446790 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-be0eb97c-c106-4787-a577-25639ab0db56 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:25.461810 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be0eb97c-c106-4787-a577-25639ab0db56 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.462646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be0eb97c-c106-4787-a577-25639ab0db56 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.464504 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be0eb97c-c106-4787-a577-25639ab0db56 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.465160 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be0eb97c-c106-4787-a577-25639ab0db56 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.542325 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:25.556585 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:25.563243 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:25.565448 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f0b9a788-4f8f-43a3-a18e-199037d46917 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.378605 Dec 18 03:15:25.566635 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 272/531] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:25 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:25.674257 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0e1c2217-f7d4-4665-8d9b-8e102b46aa80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:25.674257 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0e1c2217-f7d4-4665-8d9b-8e102b46aa80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:25.680738 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0e1c2217-f7d4-4665-8d9b-8e102b46aa80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.681205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0e1c2217-f7d4-4665-8d9b-8e102b46aa80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.682020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0e1c2217-f7d4-4665-8d9b-8e102b46aa80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.682451 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0e1c2217-f7d4-4665-8d9b-8e102b46aa80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.782999 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-be0eb97c-c106-4787-a577-25639ab0db56 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:25.791522 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-be0eb97c-c106-4787-a577-25639ab0db56 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1513 microversion: 2.1 time: 0.352941 Dec 18 03:15:25.803284 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 260/532] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:25 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:25.927053 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0e1c2217-f7d4-4665-8d9b-8e102b46aa80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:25.935306 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0e1c2217-f7d4-4665-8d9b-8e102b46aa80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.270211 Dec 18 03:15:25.936307 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 273/533] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:25 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:25.948233 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-31308180-8baf-4be1-9b03-d511edecdcaa tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:25.949060 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-31308180-8baf-4be1-9b03-d511edecdcaa tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:25.966642 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-31308180-8baf-4be1-9b03-d511edecdcaa tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.967861 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-31308180-8baf-4be1-9b03-d511edecdcaa tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.970427 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-618061ba-9add-4144-b7dc-18d886c7b60a req-6b822078-8e57-4f75-88a6-fd05ad789944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f325d5a-7adf-4af8-8559-7f60b99ed6e2", "name": "network-vif-deleted", "tag": "7d0395bd-af1a-4b29-b3f8-68ce84d329fc"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:25.971714 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-31308180-8baf-4be1-9b03-d511edecdcaa tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.973147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-31308180-8baf-4be1-9b03-d511edecdcaa tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.973337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:15:25.973337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:15:25.984679 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-618061ba-9add-4144-b7dc-18d886c7b60a req-6b822078-8e57-4f75-88a6-fd05ad789944 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:25.985500 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-618061ba-9add-4144-b7dc-18d886c7b60a req-6b822078-8e57-4f75-88a6-fd05ad789944 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:25.999120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-618061ba-9add-4144-b7dc-18d886c7b60a req-6b822078-8e57-4f75-88a6-fd05ad789944 service nova] Creating event network-vif-deleted:7d0395bd-af1a-4b29-b3f8-68ce84d329fc for instance 9f325d5a-7adf-4af8-8559-7f60b99ed6e2 on hv-cinder-81803 Dec 18 03:15:26.005178 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-618061ba-9add-4144-b7dc-18d886c7b60a req-6b822078-8e57-4f75-88a6-fd05ad789944 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039656 Dec 18 03:15:26.010021 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 274/534] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:15:26.041478 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-31308180-8baf-4be1-9b03-d511edecdcaa tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:26.048752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-31308180-8baf-4be1-9b03-d511edecdcaa tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1473 microversion: 2.1 time: 0.104192 Dec 18 03:15:26.049327 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 261/535] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:25 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1473 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:26.585063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:26.586022 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:26.592154 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.592598 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:26.593428 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.593888 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:26.727133 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-07c4306a-4083-4c0d-9c99-bbae7b01c932 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:26.727905 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-07c4306a-4083-4c0d-9c99-bbae7b01c932 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:26.734634 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-07c4306a-4083-4c0d-9c99-bbae7b01c932 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.735077 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-07c4306a-4083-4c0d-9c99-bbae7b01c932 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:26.735845 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-07c4306a-4083-4c0d-9c99-bbae7b01c932 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.736272 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-07c4306a-4083-4c0d-9c99-bbae7b01c932 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:26.787732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:26.796552 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:26.798102 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:26.799492 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-84b9e25a-66c0-48ed-beac-bc39ae69ae23 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.219055 Dec 18 03:15:26.803206 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 275/536] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:26 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:26.821587 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3810fe7e-fdbf-4c2e-bb53-bb37165d50ee tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:26.822283 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3810fe7e-fdbf-4c2e-bb53-bb37165d50ee tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:26.833036 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3810fe7e-fdbf-4c2e-bb53-bb37165d50ee tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.833488 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3810fe7e-fdbf-4c2e-bb53-bb37165d50ee tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:26.834482 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3810fe7e-fdbf-4c2e-bb53-bb37165d50ee tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.835084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3810fe7e-fdbf-4c2e-bb53-bb37165d50ee tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:26.875843 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-07c4306a-4083-4c0d-9c99-bbae7b01c932 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:26.883754 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-07c4306a-4083-4c0d-9c99-bbae7b01c932 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1514 microversion: 2.1 time: 0.160667 Dec 18 03:15:26.884336 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 262/537] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:26 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:26.899673 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-eba5c453-f2ee-4da7-9873-6d74f8383512 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9719f89-281d-41bb-b7a9-dc0630d2e145"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:26.900807 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-eba5c453-f2ee-4da7-9873-6d74f8383512 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:26.906951 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eba5c453-f2ee-4da7-9873-6d74f8383512 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.907394 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eba5c453-f2ee-4da7-9873-6d74f8383512 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:26.908361 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eba5c453-f2ee-4da7-9873-6d74f8383512 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.908791 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eba5c453-f2ee-4da7-9873-6d74f8383512 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:26.968419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3810fe7e-fdbf-4c2e-bb53-bb37165d50ee tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:26.976280 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3810fe7e-fdbf-4c2e-bb53-bb37165d50ee tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1513 microversion: 2.1 time: 0.170723 Dec 18 03:15:26.976927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 276/538] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:26 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:26.981768 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3fe8018a-9bac-4b73-a69c-b8e6a9342166 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:26.982632 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3fe8018a-9bac-4b73-a69c-b8e6a9342166 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:26.991128 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fe8018a-9bac-4b73-a69c-b8e6a9342166 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.991574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fe8018a-9bac-4b73-a69c-b8e6a9342166 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:26.992357 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fe8018a-9bac-4b73-a69c-b8e6a9342166 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:26.992790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fe8018a-9bac-4b73-a69c-b8e6a9342166 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:27.153066 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3fe8018a-9bac-4b73-a69c-b8e6a9342166 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:27.161601 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3fe8018a-9bac-4b73-a69c-b8e6a9342166 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.183058 Dec 18 03:15:27.164007 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 277/539] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:26 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:27.167936 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:27.168278 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:27.174753 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:27.175191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:27.175967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:27.176470 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:27.213502 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:27.214149 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:27.214704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lazy-loading 'fault' on Instance uuid 9f325d5a-7adf-4af8-8559-7f60b99ed6e2 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:15:27.265374 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-eba5c453-f2ee-4da7-9873-6d74f8383512 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369374 Dec 18 03:15:27.266757 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 263/540] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:15:26 2021] POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:15:27.293737 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208a33c69dc44f399bac2a34bc018ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04a810a1bed41eb90634777ccbde0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:27.302793 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d6f2c934-4426-477e-b242-dca12ca1fdc7 tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 200 len: 1308 microversion: 2.1 time: 0.138200 Dec 18 03:15:27.305674 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 278/541] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:27 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:27.652832 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-d6d08e80-72b5-4883-8bd7-a85766c47800 req-d3f38515-fafd-4158-9e58-4b231103937d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57492c3-936b-4bd6-a228-ea2828faae96", "name": "network-vif-deleted", "tag": "4f8c374e-f41c-48e6-9acf-025bf9c609dc"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:27.654418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:15:27.654418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:15:27.661904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-d6d08e80-72b5-4883-8bd7-a85766c47800 req-d3f38515-fafd-4158-9e58-4b231103937d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:27.662627 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-d6d08e80-72b5-4883-8bd7-a85766c47800 req-d3f38515-fafd-4158-9e58-4b231103937d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:27.673864 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-d6d08e80-72b5-4883-8bd7-a85766c47800 req-d3f38515-fafd-4158-9e58-4b231103937d service nova] Creating event network-vif-deleted:4f8c374e-f41c-48e6-9acf-025bf9c609dc for instance c57492c3-936b-4bd6-a228-ea2828faae96 on hv-cinder-81803 Dec 18 03:15:27.680374 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-d6d08e80-72b5-4883-8bd7-a85766c47800 req-d3f38515-fafd-4158-9e58-4b231103937d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032626 Dec 18 03:15:27.681339 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 264/542] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:15:27.801139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-0c872d8c-0e33-4e2c-ac20-501cf0a7c77e req-8a32ef4f-c266-4932-b357-e7a717279e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa82caa-8340-4f50-9989-2ddbc243fb40", "name": "network-vif-plugged", "status": "completed", "tag": "b9de074c-64ba-4630-b439-f53e09e04d4b"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:27.802936 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:15:27.802936 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:15:27.810371 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-0c872d8c-0e33-4e2c-ac20-501cf0a7c77e req-8a32ef4f-c266-4932-b357-e7a717279e2b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:27.810783 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-0c872d8c-0e33-4e2c-ac20-501cf0a7c77e req-8a32ef4f-c266-4932-b357-e7a717279e2b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:27.821442 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:27.822171 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:27.827306 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-0c872d8c-0e33-4e2c-ac20-501cf0a7c77e req-8a32ef4f-c266-4932-b357-e7a717279e2b service nova] Creating event network-vif-plugged:b9de074c-64ba-4630-b439-f53e09e04d4b for instance aaa82caa-8340-4f50-9989-2ddbc243fb40 on hv-cinder-81803 Dec 18 03:15:27.828593 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:27.829260 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:27.830288 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:27.830884 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:27.832251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-0c872d8c-0e33-4e2c-ac20-501cf0a7c77e req-8a32ef4f-c266-4932-b357-e7a717279e2b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034781 Dec 18 03:15:27.833467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 279/543] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:15:27.972454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:27.981080 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:27.982588 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:27.983750 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-650525ba-056d-4f0b-aa90-5e56561363bf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.167450 Dec 18 03:15:27.984271 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 265/544] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:27 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:15:27.993966 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:27.994745 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:28.001128 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:28.001571 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:28.002376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:28.002855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:28.032604 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:28.033069 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:28.033505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lazy-loading 'fault' on Instance uuid c57492c3-936b-4bd6-a228-ea2828faae96 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:15:28.075527 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:28.084049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-326116ad-6931-49a5-804a-7025ded69e51 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 200 len: 1309 microversion: 2.1 time: 0.093920 Dec 18 03:15:28.084768 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 280/545] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:27 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:28.179418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-04db596e-305c-4482-ba51-a68433f29366 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:28.180054 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-04db596e-305c-4482-ba51-a68433f29366 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:28.186324 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-04db596e-305c-4482-ba51-a68433f29366 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:28.186767 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-04db596e-305c-4482-ba51-a68433f29366 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:28.187529 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-04db596e-305c-4482-ba51-a68433f29366 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:28.187953 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-04db596e-305c-4482-ba51-a68433f29366 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:28.321584 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3cd604d4-753c-4f79-a332-8c7d170e5b5d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:28.322811 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3cd604d4-753c-4f79-a332-8c7d170e5b5d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] [instance: 9f325d5a-7adf-4af8-8559-7f60b99ed6e2] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:28.329788 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3cd604d4-753c-4f79-a332-8c7d170e5b5d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:28.333979 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-04db596e-305c-4482-ba51-a68433f29366 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:28.337201 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3cd604d4-753c-4f79-a332-8c7d170e5b5d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:28.341431 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-04db596e-305c-4482-ba51-a68433f29366 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.166229 Dec 18 03:15:28.342192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 266/546] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:28 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:28.352677 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3cd604d4-753c-4f79-a332-8c7d170e5b5d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:28.353276 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3cd604d4-753c-4f79-a332-8c7d170e5b5d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:28.368884 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-3cd604d4-753c-4f79-a332-8c7d170e5b5d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] HTTP exception thrown: Instance 9f325d5a-7adf-4af8-8559-7f60b99ed6e2 could not be found. Dec 18 03:15:28.369469 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3cd604d4-753c-4f79-a332-8c7d170e5b5d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] Returning 404 to user: Instance 9f325d5a-7adf-4af8-8559-7f60b99ed6e2 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:15:28.370313 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3cd604d4-753c-4f79-a332-8c7d170e5b5d tempest-AttachVolumeNegativeTest-1367066380 tempest-AttachVolumeNegativeTest-1367066380-project] 10.222.0.24 "GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2" status: 404 len: 111 microversion: 2.1 time: 0.053849 Dec 18 03:15:28.370855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 281/547] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:28 2021] GET /compute/v2.1/servers/9f325d5a-7adf-4af8-8559-7f60b99ed6e2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:15:29.002265 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:29.002866 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:29.009159 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:29.009596 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:29.010411 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:29.010827 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:29.102621 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3c620344-7825-40f2-baa8-05e7d1a09b46 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:29.103328 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3c620344-7825-40f2-baa8-05e7d1a09b46 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: c57492c3-936b-4bd6-a228-ea2828faae96] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:29.110101 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c620344-7825-40f2-baa8-05e7d1a09b46 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:29.110808 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c620344-7825-40f2-baa8-05e7d1a09b46 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:29.111908 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c620344-7825-40f2-baa8-05e7d1a09b46 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:29.112432 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3c620344-7825-40f2-baa8-05e7d1a09b46 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:29.128719 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-3c620344-7825-40f2-baa8-05e7d1a09b46 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] HTTP exception thrown: Instance c57492c3-936b-4bd6-a228-ea2828faae96 could not be found. Dec 18 03:15:29.129493 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3c620344-7825-40f2-baa8-05e7d1a09b46 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Returning 404 to user: Instance c57492c3-936b-4bd6-a228-ea2828faae96 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:15:29.130689 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3c620344-7825-40f2-baa8-05e7d1a09b46 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96" status: 404 len: 111 microversion: 2.1 time: 0.032464 Dec 18 03:15:29.144928 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 282/548] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:29 2021] GET /compute/v2.1/servers/c57492c3-936b-4bd6-a228-ea2828faae96 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 18 03:15:29.158214 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:29.170416 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:29.172040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:29.173310 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a074e84a-b313-4546-b8e5-0038c4b31ebc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.174736 Dec 18 03:15:29.174136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 267/549] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:28 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:29.359031 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bb9e18f0-a175-434e-827d-b728fbdbdb44 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:29.359790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bb9e18f0-a175-434e-827d-b728fbdbdb44 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:29.366027 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb9e18f0-a175-434e-827d-b728fbdbdb44 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:29.366468 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb9e18f0-a175-434e-827d-b728fbdbdb44 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:29.367237 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb9e18f0-a175-434e-827d-b728fbdbdb44 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:29.367669 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb9e18f0-a175-434e-827d-b728fbdbdb44 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:29.539340 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bb9e18f0-a175-434e-827d-b728fbdbdb44 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:29.547287 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bb9e18f0-a175-434e-827d-b728fbdbdb44 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.192197 Dec 18 03:15:29.547848 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 283/550] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:29 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:30.192752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:30.193420 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:30.199853 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:30.200301 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:30.201084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:30.201522 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:30.336854 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:30.345197 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:30.346764 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:30.347922 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3acf1046-9e67-49bb-be87-fb6f9e741196 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.158989 Dec 18 03:15:30.349577 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 268/551] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:30 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:30.564111 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-015c5eb0-3b69-4825-b59d-8994ffd3de4d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:30.564715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-015c5eb0-3b69-4825-b59d-8994ffd3de4d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:30.571581 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-015c5eb0-3b69-4825-b59d-8994ffd3de4d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:30.572020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-015c5eb0-3b69-4825-b59d-8994ffd3de4d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:30.572991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-015c5eb0-3b69-4825-b59d-8994ffd3de4d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:30.573421 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-015c5eb0-3b69-4825-b59d-8994ffd3de4d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:30.703142 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-015c5eb0-3b69-4825-b59d-8994ffd3de4d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:30.711435 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-015c5eb0-3b69-4825-b59d-8994ffd3de4d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.151029 Dec 18 03:15:30.712005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 284/552] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:30 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:31.367289 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:31.367897 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:31.374099 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:31.374543 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:31.375310 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:31.375740 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:31.508688 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:31.517081 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:31.518594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:31.519736 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-63deacc0-5a84-4791-9412-fe1d9404b968 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.156676 Dec 18 03:15:31.520489 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 269/553] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:31 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:31.728306 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5605c421-8c90-494f-b23a-7383466faf43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:31.728817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5605c421-8c90-494f-b23a-7383466faf43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:31.735400 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5605c421-8c90-494f-b23a-7383466faf43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:31.735836 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5605c421-8c90-494f-b23a-7383466faf43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:31.736595 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5605c421-8c90-494f-b23a-7383466faf43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:31.737019 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5605c421-8c90-494f-b23a-7383466faf43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:31.868407 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5605c421-8c90-494f-b23a-7383466faf43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:31.875744 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5605c421-8c90-494f-b23a-7383466faf43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.151106 Dec 18 03:15:31.876305 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 285/554] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:31 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:32.538620 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:32.539225 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:32.545402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:32.545881 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:32.546644 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:32.547071 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:32.715927 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:32.724728 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:32.726238 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:32.727370 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-db43aef4-121c-4576-b72c-a2699bd30139 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1809 microversion: 2.20 time: 0.193117 Dec 18 03:15:32.727917 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 270/555] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:32 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:32.892117 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b96d4161-22d5-4200-9636-f59a09a6d71a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:32.892722 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b96d4161-22d5-4200-9636-f59a09a6d71a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:32.900188 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b96d4161-22d5-4200-9636-f59a09a6d71a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:32.900719 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b96d4161-22d5-4200-9636-f59a09a6d71a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:32.901396 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b96d4161-22d5-4200-9636-f59a09a6d71a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:32.901855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b96d4161-22d5-4200-9636-f59a09a6d71a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:33.053013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b96d4161-22d5-4200-9636-f59a09a6d71a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:33.062005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b96d4161-22d5-4200-9636-f59a09a6d71a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.173441 Dec 18 03:15:33.062854 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 286/556] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:32 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:33.745649 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:33.746506 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:33.752926 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:33.753460 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:33.754521 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:33.755027 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:33.896382 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:33.907010 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:33.908869 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:33.910068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f04e53ca-116a-47cd-8bce-00f34cf11c57 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1796 microversion: 2.20 time: 0.168174 Dec 18 03:15:33.911279 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 271/557] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:15:33 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1796 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:15:34.079336 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f3c5e582-4056-407b-8ced-91de7b5b52a2 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:34.080808 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f3c5e582-4056-407b-8ced-91de7b5b52a2 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:34.087996 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3c5e582-4056-407b-8ced-91de7b5b52a2 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:34.088440 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3c5e582-4056-407b-8ced-91de7b5b52a2 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:34.089213 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3c5e582-4056-407b-8ced-91de7b5b52a2 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:34.089663 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f3c5e582-4056-407b-8ced-91de7b5b52a2 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:34.222404 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f3c5e582-4056-407b-8ced-91de7b5b52a2 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:34.230656 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f3c5e582-4056-407b-8ced-91de7b5b52a2 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.155080 Dec 18 03:15:34.231216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 287/558] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:34 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:34.603824 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-dca54220-454d-4a7f-9195-c41aa450e54a req-9e256270-1268-44b0-b356-8da195ab008f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9e593b-0924-4c44-b1f2-e978a0a72025", "name": "network-vif-plugged", "status": "completed", "tag": "3c025ffb-e617-491c-82db-5bbcb6fa0c38"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:34.605671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:15:34.605671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:15:34.613024 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-dca54220-454d-4a7f-9195-c41aa450e54a req-9e256270-1268-44b0-b356-8da195ab008f service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:34.613943 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-dca54220-454d-4a7f-9195-c41aa450e54a req-9e256270-1268-44b0-b356-8da195ab008f service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:34.642494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-dca54220-454d-4a7f-9195-c41aa450e54a req-9e256270-1268-44b0-b356-8da195ab008f service nova] Creating event network-vif-plugged:3c025ffb-e617-491c-82db-5bbcb6fa0c38 for instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 on hv-cinder-81803 Dec 18 03:15:34.656898 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-dca54220-454d-4a7f-9195-c41aa450e54a req-9e256270-1268-44b0-b356-8da195ab008f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054588 Dec 18 03:15:34.657509 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 272/559] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:15:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:15:34.822991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9d8d194c-8b8e-4885-b97d-d72baebc10cf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:34.824171 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9d8d194c-8b8e-4885-b97d-d72baebc10cf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:34.830282 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9d8d194c-8b8e-4885-b97d-d72baebc10cf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:34.830728 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9d8d194c-8b8e-4885-b97d-d72baebc10cf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:34.831523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9d8d194c-8b8e-4885-b97d-d72baebc10cf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:34.831951 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9d8d194c-8b8e-4885-b97d-d72baebc10cf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:34.856580 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-9d8d194c-8b8e-4885-b97d-d72baebc10cf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lazy-loading 'flavor' on Instance uuid d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:15:35.000797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9d8d194c-8b8e-4885-b97d-d72baebc10cf tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/action" status: 200 len: 32 microversion: 2.1 time: 0.181681 Dec 18 03:15:35.001752 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 288/560] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:15:34 2021] POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 03:15:35.013061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-58c4a89a-b9fb-4507-a422-2e7bc855ab45 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:35.014007 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-58c4a89a-b9fb-4507-a422-2e7bc855ab45 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:35.021360 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-58c4a89a-b9fb-4507-a422-2e7bc855ab45 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:35.021553 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-58c4a89a-b9fb-4507-a422-2e7bc855ab45 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:35.022544 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-58c4a89a-b9fb-4507-a422-2e7bc855ab45 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:35.022973 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-58c4a89a-b9fb-4507-a422-2e7bc855ab45 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:35.197018 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-58c4a89a-b9fb-4507-a422-2e7bc855ab45 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:35.204833 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-58c4a89a-b9fb-4507-a422-2e7bc855ab45 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.196370 Dec 18 03:15:35.205391 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 273/561] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:35 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:35.248256 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5417955c-59d2-4022-94c8-8810020895e0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:35.248958 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5417955c-59d2-4022-94c8-8810020895e0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:35.256373 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5417955c-59d2-4022-94c8-8810020895e0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:35.256836 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5417955c-59d2-4022-94c8-8810020895e0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:35.257696 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5417955c-59d2-4022-94c8-8810020895e0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:35.258137 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5417955c-59d2-4022-94c8-8810020895e0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:35.430424 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5417955c-59d2-4022-94c8-8810020895e0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:35.437893 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5417955c-59d2-4022-94c8-8810020895e0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.193741 Dec 18 03:15:35.438545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 289/562] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:35 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:36.222656 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5e290d4a-ac68-4792-a265-2b2722df3ff3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:36.223879 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5e290d4a-ac68-4792-a265-2b2722df3ff3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:36.230391 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5e290d4a-ac68-4792-a265-2b2722df3ff3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:36.230839 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5e290d4a-ac68-4792-a265-2b2722df3ff3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:36.231614 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5e290d4a-ac68-4792-a265-2b2722df3ff3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:36.232048 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5e290d4a-ac68-4792-a265-2b2722df3ff3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:36.368971 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5e290d4a-ac68-4792-a265-2b2722df3ff3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:36.377444 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5e290d4a-ac68-4792-a265-2b2722df3ff3 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.158379 Dec 18 03:15:36.378302 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 274/563] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:36 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:36.455409 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9458586b-125b-4d55-9683-68bba98e721c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:36.456010 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9458586b-125b-4d55-9683-68bba98e721c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:36.462927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9458586b-125b-4d55-9683-68bba98e721c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:36.463307 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9458586b-125b-4d55-9683-68bba98e721c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:36.464113 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9458586b-125b-4d55-9683-68bba98e721c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:36.464543 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9458586b-125b-4d55-9683-68bba98e721c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:36.605647 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9458586b-125b-4d55-9683-68bba98e721c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:36.612795 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9458586b-125b-4d55-9683-68bba98e721c tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.160991 Dec 18 03:15:36.613430 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 290/564] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:36 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:37.394618 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1b7e46a4-8f3c-4114-8334-ed5cb52f6b6b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:37.396067 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1b7e46a4-8f3c-4114-8334-ed5cb52f6b6b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:37.402890 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1b7e46a4-8f3c-4114-8334-ed5cb52f6b6b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:37.403536 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1b7e46a4-8f3c-4114-8334-ed5cb52f6b6b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:37.404513 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1b7e46a4-8f3c-4114-8334-ed5cb52f6b6b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:37.405096 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1b7e46a4-8f3c-4114-8334-ed5cb52f6b6b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:37.541060 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1b7e46a4-8f3c-4114-8334-ed5cb52f6b6b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:37.548752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1b7e46a4-8f3c-4114-8334-ed5cb52f6b6b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.157875 Dec 18 03:15:37.549311 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 275/565] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:37 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:37.630509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f9e603a8-9583-4e59-a2ca-d8e6af087401 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:37.631242 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f9e603a8-9583-4e59-a2ca-d8e6af087401 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:37.637362 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f9e603a8-9583-4e59-a2ca-d8e6af087401 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:37.637910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f9e603a8-9583-4e59-a2ca-d8e6af087401 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:37.638794 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f9e603a8-9583-4e59-a2ca-d8e6af087401 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:37.639301 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f9e603a8-9583-4e59-a2ca-d8e6af087401 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:37.820222 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f9e603a8-9583-4e59-a2ca-d8e6af087401 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:37.827545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f9e603a8-9583-4e59-a2ca-d8e6af087401 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.201261 Dec 18 03:15:37.828273 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 291/566] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:37 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:38.565525 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-67cdc469-9168-4f3b-a97a-543224c95d38 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:38.566224 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-67cdc469-9168-4f3b-a97a-543224c95d38 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:38.574296 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-67cdc469-9168-4f3b-a97a-543224c95d38 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:38.574739 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-67cdc469-9168-4f3b-a97a-543224c95d38 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:38.575521 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-67cdc469-9168-4f3b-a97a-543224c95d38 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:38.575965 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-67cdc469-9168-4f3b-a97a-543224c95d38 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:38.714390 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-67cdc469-9168-4f3b-a97a-543224c95d38 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:38.722377 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-67cdc469-9168-4f3b-a97a-543224c95d38 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.160661 Dec 18 03:15:38.723941 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 276/567] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:38 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:38.844080 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ee02e16f-46ae-4a00-9a64-02e1e115dd43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:38.844764 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ee02e16f-46ae-4a00-9a64-02e1e115dd43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:38.851266 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee02e16f-46ae-4a00-9a64-02e1e115dd43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:38.851925 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee02e16f-46ae-4a00-9a64-02e1e115dd43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:38.852712 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee02e16f-46ae-4a00-9a64-02e1e115dd43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:38.853165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee02e16f-46ae-4a00-9a64-02e1e115dd43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:38.992995 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ee02e16f-46ae-4a00-9a64-02e1e115dd43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:39.001345 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ee02e16f-46ae-4a00-9a64-02e1e115dd43 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1264 microversion: 2.1 time: 0.160550 Dec 18 03:15:39.002234 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 292/568] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:38 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:39.030769 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1512609918", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "networks": [{"uuid": "8ae16f07-c695-4581-a1d1-000cf62d9722"}]}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:39.084053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] validate_networks() for [('8ae16f07-c695-4581-a1d1-000cf62d9722', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:15:39.444590 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:15:39.445031 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:15:39.445519 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:15:39.446293 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:15:39.446859 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:15:39.456210 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:39.456653 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:39.457484 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:39.458132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:39.475510 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Getting quotas for project 2332e8c0e55443e4850ccea9e08376d9. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:15:39.479468 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Getting quotas for user cbac9dd3aff24720b114c16fac5bee71 and project 2332e8c0e55443e4850ccea9e08376d9. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:15:39.491113 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:15:39.493426 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:15:39.536994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-887d9d49-df53-4591-ba04-cef9570cf275 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510066 Dec 18 03:15:39.537729 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 277/569] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:15:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:15:39.547587 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a34c02dd-f135-431e-9faf-73c3c60e5e1d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:39.548198 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a34c02dd-f135-431e-9faf-73c3c60e5e1d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:39.608571 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a34c02dd-f135-431e-9faf-73c3c60e5e1d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:39.617020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a34c02dd-f135-431e-9faf-73c3c60e5e1d tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1219 microversion: 2.1 time: 0.073102 Dec 18 03:15:39.617796 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 293/570] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:39 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:39.741928 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bc71a52a-5ee9-49f9-94a0-45ffdb22c8ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:39.742540 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bc71a52a-5ee9-49f9-94a0-45ffdb22c8ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:39.748898 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bc71a52a-5ee9-49f9-94a0-45ffdb22c8ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:39.749341 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bc71a52a-5ee9-49f9-94a0-45ffdb22c8ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:39.750152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bc71a52a-5ee9-49f9-94a0-45ffdb22c8ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:39.750676 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bc71a52a-5ee9-49f9-94a0-45ffdb22c8ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:39.901418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bc71a52a-5ee9-49f9-94a0-45ffdb22c8ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:39.909466 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bc71a52a-5ee9-49f9-94a0-45ffdb22c8ab tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.172715 Dec 18 03:15:39.910059 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 278/571] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:39 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:40.017984 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-79cd8506-7684-49be-8d2a-ce0d1988c1c9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:40.018643 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-79cd8506-7684-49be-8d2a-ce0d1988c1c9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:40.025606 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-79cd8506-7684-49be-8d2a-ce0d1988c1c9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:40.026078 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-79cd8506-7684-49be-8d2a-ce0d1988c1c9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:40.026866 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-79cd8506-7684-49be-8d2a-ce0d1988c1c9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:40.027610 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-79cd8506-7684-49be-8d2a-ce0d1988c1c9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:40.179254 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-79cd8506-7684-49be-8d2a-ce0d1988c1c9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:40.187245 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-79cd8506-7684-49be-8d2a-ce0d1988c1c9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1452 microversion: 2.1 time: 0.172825 Dec 18 03:15:40.187808 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 294/572] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:40 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:40.204068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-73540664-d07a-4d8c-85b5-2805216133ca tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:40.204671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-73540664-d07a-4d8c-85b5-2805216133ca tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:40.210757 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73540664-d07a-4d8c-85b5-2805216133ca tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:40.211200 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73540664-d07a-4d8c-85b5-2805216133ca tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:40.211969 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73540664-d07a-4d8c-85b5-2805216133ca tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:40.212396 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-73540664-d07a-4d8c-85b5-2805216133ca tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:40.344742 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-73540664-d07a-4d8c-85b5-2805216133ca tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:40.353137 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-73540664-d07a-4d8c-85b5-2805216133ca tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1452 microversion: 2.1 time: 0.152639 Dec 18 03:15:40.353818 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 279/573] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:40 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:40.633461 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-94dd9fc4-cf02-4164-aa57-86d77b73da05 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:40.634098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-94dd9fc4-cf02-4164-aa57-86d77b73da05 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:40.639901 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-94dd9fc4-cf02-4164-aa57-86d77b73da05 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:40.640338 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-94dd9fc4-cf02-4164-aa57-86d77b73da05 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:40.641136 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-94dd9fc4-cf02-4164-aa57-86d77b73da05 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:40.641567 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-94dd9fc4-cf02-4164-aa57-86d77b73da05 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:40.704128 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-94dd9fc4-cf02-4164-aa57-86d77b73da05 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:40.712560 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-94dd9fc4-cf02-4164-aa57-86d77b73da05 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1279 microversion: 2.1 time: 0.082713 Dec 18 03:15:40.713600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 295/574] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:40 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:40.925965 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a931211a-47c1-4d97-b079-e2ff82827cba tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:40.926564 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a931211a-47c1-4d97-b079-e2ff82827cba tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:40.932942 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a931211a-47c1-4d97-b079-e2ff82827cba tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:40.933494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a931211a-47c1-4d97-b079-e2ff82827cba tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:40.934309 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a931211a-47c1-4d97-b079-e2ff82827cba tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:40.934737 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a931211a-47c1-4d97-b079-e2ff82827cba tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:41.276759 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a931211a-47c1-4d97-b079-e2ff82827cba tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:41.287352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a931211a-47c1-4d97-b079-e2ff82827cba tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.364891 Dec 18 03:15:41.287848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 280/575] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:40 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:41.729096 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-607b3be7-8a51-483d-9328-1cfb3cde56b2 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:41.730559 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-607b3be7-8a51-483d-9328-1cfb3cde56b2 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:41.737666 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-607b3be7-8a51-483d-9328-1cfb3cde56b2 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:41.738202 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-607b3be7-8a51-483d-9328-1cfb3cde56b2 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:41.739146 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-607b3be7-8a51-483d-9328-1cfb3cde56b2 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:41.739845 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-607b3be7-8a51-483d-9328-1cfb3cde56b2 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:41.883259 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-607b3be7-8a51-483d-9328-1cfb3cde56b2 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:41.891211 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-607b3be7-8a51-483d-9328-1cfb3cde56b2 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.165867 Dec 18 03:15:41.891952 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 296/576] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:41 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:42.304252 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-143fdcfe-3554-4704-9e35-f4ec41d28f7b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:42.305224 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-143fdcfe-3554-4704-9e35-f4ec41d28f7b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:42.311435 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-143fdcfe-3554-4704-9e35-f4ec41d28f7b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:42.311878 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-143fdcfe-3554-4704-9e35-f4ec41d28f7b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:42.312661 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-143fdcfe-3554-4704-9e35-f4ec41d28f7b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:42.313089 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-143fdcfe-3554-4704-9e35-f4ec41d28f7b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:42.762728 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-143fdcfe-3554-4704-9e35-f4ec41d28f7b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:42.773441 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-143fdcfe-3554-4704-9e35-f4ec41d28f7b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.473408 Dec 18 03:15:42.783643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 281/577] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:42 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:42.908321 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-18e2cfc3-2e3c-4623-ab50-878742799f2e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:42.908927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-18e2cfc3-2e3c-4623-ab50-878742799f2e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:42.915443 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18e2cfc3-2e3c-4623-ab50-878742799f2e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:42.915881 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18e2cfc3-2e3c-4623-ab50-878742799f2e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:42.916647 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18e2cfc3-2e3c-4623-ab50-878742799f2e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:42.917071 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18e2cfc3-2e3c-4623-ab50-878742799f2e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:43.055651 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-18e2cfc3-2e3c-4623-ab50-878742799f2e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:43.065906 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-18e2cfc3-2e3c-4623-ab50-878742799f2e tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.160988 Dec 18 03:15:43.069798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 297/578] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:42 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:43.575604 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-574daf65-6c2f-4fa7-afaa-5053b7cf909a req-cc7a0f8d-52b9-485a-b308-aefab49ad6fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b5018f-4714-4b42-b899-c27732d501ed", "tag": "a25da932-c153-48ba-b3f3-47beba28720b"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:43.577576 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:15:43.577576 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:15:43.585899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-574daf65-6c2f-4fa7-afaa-5053b7cf909a req-cc7a0f8d-52b9-485a-b308-aefab49ad6fd service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:43.586485 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-574daf65-6c2f-4fa7-afaa-5053b7cf909a req-cc7a0f8d-52b9-485a-b308-aefab49ad6fd service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:43.599504 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-574daf65-6c2f-4fa7-afaa-5053b7cf909a req-cc7a0f8d-52b9-485a-b308-aefab49ad6fd service nova] Creating event network-changed:a25da932-c153-48ba-b3f3-47beba28720b for instance 99b5018f-4714-4b42-b899-c27732d501ed on hv-cinder-81803 Dec 18 03:15:43.604576 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-574daf65-6c2f-4fa7-afaa-5053b7cf909a req-cc7a0f8d-52b9-485a-b308-aefab49ad6fd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038696 Dec 18 03:15:43.605424 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 282/579] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:15:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:15:43.790993 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-47db5972-77d3-457b-9e66-e2bc2233d89c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:43.791598 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-47db5972-77d3-457b-9e66-e2bc2233d89c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:43.797488 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-47db5972-77d3-457b-9e66-e2bc2233d89c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:43.797904 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-47db5972-77d3-457b-9e66-e2bc2233d89c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:43.798693 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-47db5972-77d3-457b-9e66-e2bc2233d89c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:43.799130 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-47db5972-77d3-457b-9e66-e2bc2233d89c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:43.943875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-47db5972-77d3-457b-9e66-e2bc2233d89c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:43.953449 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-47db5972-77d3-457b-9e66-e2bc2233d89c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.165952 Dec 18 03:15:43.957919 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 298/580] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:43 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:44.085237 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-33a05a57-8007-4a4a-b892-524f7e2617c0 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:44.086462 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-33a05a57-8007-4a4a-b892-524f7e2617c0 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:44.092661 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-33a05a57-8007-4a4a-b892-524f7e2617c0 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:44.093460 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-33a05a57-8007-4a4a-b892-524f7e2617c0 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:44.094501 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-33a05a57-8007-4a4a-b892-524f7e2617c0 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:44.095055 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-33a05a57-8007-4a4a-b892-524f7e2617c0 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:44.264016 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-33a05a57-8007-4a4a-b892-524f7e2617c0 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:44.272472 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-33a05a57-8007-4a4a-b892-524f7e2617c0 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.192120 Dec 18 03:15:44.273505 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 283/581] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:44 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:44.976588 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-49d3c192-e309-46c7-978b-a9c790fb7a4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:44.977902 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-49d3c192-e309-46c7-978b-a9c790fb7a4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:44.984971 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-49d3c192-e309-46c7-978b-a9c790fb7a4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:44.985579 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-49d3c192-e309-46c7-978b-a9c790fb7a4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:44.987085 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-49d3c192-e309-46c7-978b-a9c790fb7a4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:44.987539 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-49d3c192-e309-46c7-978b-a9c790fb7a4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:45.136317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-49d3c192-e309-46c7-978b-a9c790fb7a4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:45.144087 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-49d3c192-e309-46c7-978b-a9c790fb7a4c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.171695 Dec 18 03:15:45.144656 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 299/582] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:44 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:45.293059 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7cabee6f-51d4-4a58-a45c-72abe878753a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:45.293586 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7cabee6f-51d4-4a58-a45c-72abe878753a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:45.299833 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7cabee6f-51d4-4a58-a45c-72abe878753a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:45.300273 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7cabee6f-51d4-4a58-a45c-72abe878753a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:45.301062 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7cabee6f-51d4-4a58-a45c-72abe878753a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:45.301572 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7cabee6f-51d4-4a58-a45c-72abe878753a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:45.434530 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7cabee6f-51d4-4a58-a45c-72abe878753a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:45.442030 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7cabee6f-51d4-4a58-a45c-72abe878753a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.152973 Dec 18 03:15:45.442579 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 284/583] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:45 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:45.642665 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-c37f8abc-bc0e-4af2-9e97-a447ca82090c req-5cf8d7b5-bd18-400d-9caa-acf2f9cfcba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9e593b-0924-4c44-b1f2-e978a0a72025", "tag": "3c025ffb-e617-491c-82db-5bbcb6fa0c38"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:45.644251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:15:45.644251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:15:45.651805 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-c37f8abc-bc0e-4af2-9e97-a447ca82090c req-5cf8d7b5-bd18-400d-9caa-acf2f9cfcba5 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:45.652237 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-c37f8abc-bc0e-4af2-9e97-a447ca82090c req-5cf8d7b5-bd18-400d-9caa-acf2f9cfcba5 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:45.662779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-c37f8abc-bc0e-4af2-9e97-a447ca82090c req-5cf8d7b5-bd18-400d-9caa-acf2f9cfcba5 service nova] Creating event network-changed:3c025ffb-e617-491c-82db-5bbcb6fa0c38 for instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 on hv-cinder-81803 Dec 18 03:15:45.667546 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-c37f8abc-bc0e-4af2-9e97-a447ca82090c req-5cf8d7b5-bd18-400d-9caa-acf2f9cfcba5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028481 Dec 18 03:15:45.668108 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 300/584] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:15:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:15:46.161732 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-74ecda4e-c0ef-43c6-8efe-a7a14c662e7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:46.162368 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-74ecda4e-c0ef-43c6-8efe-a7a14c662e7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:46.168207 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-74ecda4e-c0ef-43c6-8efe-a7a14c662e7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:46.168643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-74ecda4e-c0ef-43c6-8efe-a7a14c662e7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:46.169412 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-74ecda4e-c0ef-43c6-8efe-a7a14c662e7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:46.169864 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-74ecda4e-c0ef-43c6-8efe-a7a14c662e7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:46.333008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-74ecda4e-c0ef-43c6-8efe-a7a14c662e7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:46.340684 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-74ecda4e-c0ef-43c6-8efe-a7a14c662e7a tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.182731 Dec 18 03:15:46.341237 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 285/585] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:46 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:15:46.458885 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1c8637dc-85a4-466f-a07d-bc533b5db482 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:46.459608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1c8637dc-85a4-466f-a07d-bc533b5db482 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:46.465677 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c8637dc-85a4-466f-a07d-bc533b5db482 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:46.466127 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c8637dc-85a4-466f-a07d-bc533b5db482 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:46.466898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c8637dc-85a4-466f-a07d-bc533b5db482 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:46.467327 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c8637dc-85a4-466f-a07d-bc533b5db482 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:46.602551 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1c8637dc-85a4-466f-a07d-bc533b5db482 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:46.610437 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1c8637dc-85a4-466f-a07d-bc533b5db482 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.155993 Dec 18 03:15:46.611015 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 301/586] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:46 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:47.357155 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fdf9b4bf-79b3-4d81-af56-b17f7bdef20c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:47.357803 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-fdf9b4bf-79b3-4d81-af56-b17f7bdef20c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:47.364789 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fdf9b4bf-79b3-4d81-af56-b17f7bdef20c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:47.365236 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fdf9b4bf-79b3-4d81-af56-b17f7bdef20c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:47.366049 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fdf9b4bf-79b3-4d81-af56-b17f7bdef20c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:47.366497 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fdf9b4bf-79b3-4d81-af56-b17f7bdef20c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:47.499612 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-fdf9b4bf-79b3-4d81-af56-b17f7bdef20c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:47.507686 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-fdf9b4bf-79b3-4d81-af56-b17f7bdef20c tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.154480 Dec 18 03:15:47.508259 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 286/587] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:47 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:47.627238 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8fb57cfc-451d-4806-8162-9dbd8972ef89 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:47.627781 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8fb57cfc-451d-4806-8162-9dbd8972ef89 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:47.633736 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8fb57cfc-451d-4806-8162-9dbd8972ef89 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:47.634181 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8fb57cfc-451d-4806-8162-9dbd8972ef89 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:47.634938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8fb57cfc-451d-4806-8162-9dbd8972ef89 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:47.635365 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8fb57cfc-451d-4806-8162-9dbd8972ef89 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:47.764870 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8fb57cfc-451d-4806-8162-9dbd8972ef89 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:47.772705 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8fb57cfc-451d-4806-8162-9dbd8972ef89 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.149398 Dec 18 03:15:47.773290 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 302/588] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:47 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:48.524652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5d64fe33-75e2-4bb1-9d29-282a314dbf29 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:48.525581 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5d64fe33-75e2-4bb1-9d29-282a314dbf29 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:48.531432 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5d64fe33-75e2-4bb1-9d29-282a314dbf29 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:48.532008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5d64fe33-75e2-4bb1-9d29-282a314dbf29 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:48.532804 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5d64fe33-75e2-4bb1-9d29-282a314dbf29 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:48.533243 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5d64fe33-75e2-4bb1-9d29-282a314dbf29 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:48.670628 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5d64fe33-75e2-4bb1-9d29-282a314dbf29 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:48.678281 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5d64fe33-75e2-4bb1-9d29-282a314dbf29 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.157921 Dec 18 03:15:48.679425 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 287/589] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:48 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:48.790055 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6c780ed9-a4e8-40b8-a591-583f4b76d7db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:48.790666 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6c780ed9-a4e8-40b8-a591-583f4b76d7db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:48.797265 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c780ed9-a4e8-40b8-a591-583f4b76d7db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:48.797926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c780ed9-a4e8-40b8-a591-583f4b76d7db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:48.798803 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c780ed9-a4e8-40b8-a591-583f4b76d7db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:48.799271 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c780ed9-a4e8-40b8-a591-583f4b76d7db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:48.931991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6c780ed9-a4e8-40b8-a591-583f4b76d7db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:48.939260 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6c780ed9-a4e8-40b8-a591-583f4b76d7db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.153520 Dec 18 03:15:48.939818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 303/590] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:48 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:49.696302 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a940e346-57e2-421f-8711-e835b272e286 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:49.696908 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a940e346-57e2-421f-8711-e835b272e286 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:49.703385 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a940e346-57e2-421f-8711-e835b272e286 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:49.703895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a940e346-57e2-421f-8711-e835b272e286 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:49.704701 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a940e346-57e2-421f-8711-e835b272e286 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:49.705139 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a940e346-57e2-421f-8711-e835b272e286 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:49.837563 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a940e346-57e2-421f-8711-e835b272e286 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:49.845211 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a940e346-57e2-421f-8711-e835b272e286 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.153208 Dec 18 03:15:49.845794 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 288/591] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:49 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:49.956200 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3fba81b0-64d8-4eba-8de4-76207668998f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:49.956752 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3fba81b0-64d8-4eba-8de4-76207668998f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:49.963004 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fba81b0-64d8-4eba-8de4-76207668998f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:49.963446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fba81b0-64d8-4eba-8de4-76207668998f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:49.964211 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fba81b0-64d8-4eba-8de4-76207668998f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:49.964643 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fba81b0-64d8-4eba-8de4-76207668998f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:50.093795 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3fba81b0-64d8-4eba-8de4-76207668998f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:50.101482 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3fba81b0-64d8-4eba-8de4-76207668998f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.149175 Dec 18 03:15:50.102125 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 304/592] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:49 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:50.699810 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-1449251b-1901-48e0-ad6d-5d413809bea5 req-4eb225f5-20a3-4157-8087-ead1c0ebda98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b5018f-4714-4b42-b899-c27732d501ed", "name": "network-vif-plugged", "status": "completed", "tag": "a25da932-c153-48ba-b3f3-47beba28720b"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:50.701369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:15:50.701369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:15:50.709501 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-1449251b-1901-48e0-ad6d-5d413809bea5 req-4eb225f5-20a3-4157-8087-ead1c0ebda98 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:50.710348 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-1449251b-1901-48e0-ad6d-5d413809bea5 req-4eb225f5-20a3-4157-8087-ead1c0ebda98 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:50.722552 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-1449251b-1901-48e0-ad6d-5d413809bea5 req-4eb225f5-20a3-4157-8087-ead1c0ebda98 service nova] Creating event network-vif-plugged:a25da932-c153-48ba-b3f3-47beba28720b for instance 99b5018f-4714-4b42-b899-c27732d501ed on hv-cinder-81803 Dec 18 03:15:50.728132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-1449251b-1901-48e0-ad6d-5d413809bea5 req-4eb225f5-20a3-4157-8087-ead1c0ebda98 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031890 Dec 18 03:15:50.728768 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 289/593] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:15:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:15:50.861830 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-706f0a07-c333-4cea-a00c-eb97fb0d72f4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:50.862771 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-706f0a07-c333-4cea-a00c-eb97fb0d72f4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:50.874520 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-706f0a07-c333-4cea-a00c-eb97fb0d72f4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:50.874984 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-706f0a07-c333-4cea-a00c-eb97fb0d72f4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:50.876078 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-706f0a07-c333-4cea-a00c-eb97fb0d72f4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:50.876561 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-706f0a07-c333-4cea-a00c-eb97fb0d72f4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:51.011611 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-706f0a07-c333-4cea-a00c-eb97fb0d72f4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:51.020348 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-706f0a07-c333-4cea-a00c-eb97fb0d72f4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.162219 Dec 18 03:15:51.020926 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 305/594] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:50 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:51.120557 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-684be6f0-4d31-4928-9e51-5be347aee2db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:51.121420 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-684be6f0-4d31-4928-9e51-5be347aee2db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:51.127548 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-684be6f0-4d31-4928-9e51-5be347aee2db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:51.127989 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-684be6f0-4d31-4928-9e51-5be347aee2db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:51.128763 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-684be6f0-4d31-4928-9e51-5be347aee2db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:51.129192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-684be6f0-4d31-4928-9e51-5be347aee2db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:51.262716 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-684be6f0-4d31-4928-9e51-5be347aee2db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:51.269951 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-684be6f0-4d31-4928-9e51-5be347aee2db tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.154358 Dec 18 03:15:51.270582 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 290/595] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:51 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:52.037295 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-aea947ec-c6f9-4ee7-9ab2-dfd2584866b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:52.038035 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-aea947ec-c6f9-4ee7-9ab2-dfd2584866b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:52.044585 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aea947ec-c6f9-4ee7-9ab2-dfd2584866b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:52.045030 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aea947ec-c6f9-4ee7-9ab2-dfd2584866b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:52.045839 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aea947ec-c6f9-4ee7-9ab2-dfd2584866b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:52.046268 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aea947ec-c6f9-4ee7-9ab2-dfd2584866b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:52.187602 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-aea947ec-c6f9-4ee7-9ab2-dfd2584866b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:52.195666 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-aea947ec-c6f9-4ee7-9ab2-dfd2584866b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.162050 Dec 18 03:15:52.196224 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 306/596] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:52 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:52.287613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-757a01c3-784b-4ed0-8998-308cf02ec6f5 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:52.288926 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-757a01c3-784b-4ed0-8998-308cf02ec6f5 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:52.295313 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-757a01c3-784b-4ed0-8998-308cf02ec6f5 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:52.295757 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-757a01c3-784b-4ed0-8998-308cf02ec6f5 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:52.296569 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-757a01c3-784b-4ed0-8998-308cf02ec6f5 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:52.297000 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-757a01c3-784b-4ed0-8998-308cf02ec6f5 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:52.444122 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-757a01c3-784b-4ed0-8998-308cf02ec6f5 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:52.452631 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-757a01c3-784b-4ed0-8998-308cf02ec6f5 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1319 microversion: 2.1 time: 0.169294 Dec 18 03:15:52.453191 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 291/597] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:52 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:53.213262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-09768c81-0372-41d3-a0af-a45748baecb6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:53.213914 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-09768c81-0372-41d3-a0af-a45748baecb6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:53.220244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-09768c81-0372-41d3-a0af-a45748baecb6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:53.220698 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-09768c81-0372-41d3-a0af-a45748baecb6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:53.221467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-09768c81-0372-41d3-a0af-a45748baecb6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:53.221924 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-09768c81-0372-41d3-a0af-a45748baecb6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:53.350259 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-09768c81-0372-41d3-a0af-a45748baecb6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:53.358303 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-09768c81-0372-41d3-a0af-a45748baecb6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.149806 Dec 18 03:15:53.358872 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 307/598] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:53 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:53.469401 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fc15c576-5f9a-4f86-88ec-8d9858c3e290 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:53.470044 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-fc15c576-5f9a-4f86-88ec-8d9858c3e290 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:53.476740 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc15c576-5f9a-4f86-88ec-8d9858c3e290 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:53.477183 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc15c576-5f9a-4f86-88ec-8d9858c3e290 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:53.478028 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc15c576-5f9a-4f86-88ec-8d9858c3e290 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:53.478463 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc15c576-5f9a-4f86-88ec-8d9858c3e290 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:53.610071 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-fc15c576-5f9a-4f86-88ec-8d9858c3e290 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:53.617715 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-fc15c576-5f9a-4f86-88ec-8d9858c3e290 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1507 microversion: 2.1 time: 0.151937 Dec 18 03:15:53.618281 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 292/599] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:53 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:53.633460 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0a768873-4c17-43b7-9f3b-3e120028f40a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42dc1326-4604-447f-be04-1a5e0176b534", "device": "/dev/sdb"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:15:53.634686 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0a768873-4c17-43b7-9f3b-3e120028f40a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:53.640480 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0a768873-4c17-43b7-9f3b-3e120028f40a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:53.640928 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0a768873-4c17-43b7-9f3b-3e120028f40a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:53.641726 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0a768873-4c17-43b7-9f3b-3e120028f40a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:53.642158 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0a768873-4c17-43b7-9f3b-3e120028f40a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:53.891109 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0a768873-4c17-43b7-9f3b-3e120028f40a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "POST /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261203 Dec 18 03:15:53.891754 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 308/600] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:15:53 2021] POST /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:15:54.375540 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-54b38031-0c84-480c-a897-791e2509c4e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:54.376056 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-54b38031-0c84-480c-a897-791e2509c4e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:54.382548 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-54b38031-0c84-480c-a897-791e2509c4e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:54.382973 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-54b38031-0c84-480c-a897-791e2509c4e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:54.383737 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-54b38031-0c84-480c-a897-791e2509c4e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:54.384160 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-54b38031-0c84-480c-a897-791e2509c4e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:54.520085 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-54b38031-0c84-480c-a897-791e2509c4e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:54.528339 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-54b38031-0c84-480c-a897-791e2509c4e8 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.156806 Dec 18 03:15:54.528925 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 293/601] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:54 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:55.546901 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6304446e-c008-4a47-8b86-570132d255d6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:55.547594 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6304446e-c008-4a47-8b86-570132d255d6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:55.554011 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6304446e-c008-4a47-8b86-570132d255d6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:55.554449 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6304446e-c008-4a47-8b86-570132d255d6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:55.555211 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6304446e-c008-4a47-8b86-570132d255d6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:55.555723 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6304446e-c008-4a47-8b86-570132d255d6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:55.686330 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6304446e-c008-4a47-8b86-570132d255d6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:55.693943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6304446e-c008-4a47-8b86-570132d255d6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.151749 Dec 18 03:15:55.694500 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 309/602] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:55 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:56.710044 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2968e47f-4001-4497-b205-0cda53d943e0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:56.710600 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2968e47f-4001-4497-b205-0cda53d943e0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:56.716785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2968e47f-4001-4497-b205-0cda53d943e0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:56.717255 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2968e47f-4001-4497-b205-0cda53d943e0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:56.718048 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2968e47f-4001-4497-b205-0cda53d943e0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:56.718481 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2968e47f-4001-4497-b205-0cda53d943e0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:56.844882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2968e47f-4001-4497-b205-0cda53d943e0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:56.853229 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2968e47f-4001-4497-b205-0cda53d943e0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.146958 Dec 18 03:15:56.853817 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 294/603] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:56 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:57.870312 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ac89d336-4676-41ce-b488-d284279e4aff tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:57.870891 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ac89d336-4676-41ce-b488-d284279e4aff tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:57.877022 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ac89d336-4676-41ce-b488-d284279e4aff tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:57.877462 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ac89d336-4676-41ce-b488-d284279e4aff tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:57.878257 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ac89d336-4676-41ce-b488-d284279e4aff tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:57.878685 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ac89d336-4676-41ce-b488-d284279e4aff tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:58.005697 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ac89d336-4676-41ce-b488-d284279e4aff tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:58.014182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ac89d336-4676-41ce-b488-d284279e4aff tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.147524 Dec 18 03:15:58.014742 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 310/604] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:57 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:15:59.031383 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7d9ef190-e62b-4211-b503-30bbcb53e87b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:15:59.032017 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7d9ef190-e62b-4211-b503-30bbcb53e87b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:15:59.038888 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d9ef190-e62b-4211-b503-30bbcb53e87b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:59.039318 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d9ef190-e62b-4211-b503-30bbcb53e87b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:59.040087 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d9ef190-e62b-4211-b503-30bbcb53e87b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:15:59.040516 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d9ef190-e62b-4211-b503-30bbcb53e87b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:15:59.171098 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7d9ef190-e62b-4211-b503-30bbcb53e87b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:15:59.179568 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7d9ef190-e62b-4211-b503-30bbcb53e87b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.151749 Dec 18 03:15:59.180136 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 295/605] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:15:59 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:00.196624 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9ab54286-edd8-4e66-95ab-9fd45b25d9a9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:00.197230 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9ab54286-edd8-4e66-95ab-9fd45b25d9a9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:00.203500 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9ab54286-edd8-4e66-95ab-9fd45b25d9a9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:00.203923 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9ab54286-edd8-4e66-95ab-9fd45b25d9a9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:00.204684 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9ab54286-edd8-4e66-95ab-9fd45b25d9a9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:00.205136 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9ab54286-edd8-4e66-95ab-9fd45b25d9a9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:00.333196 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9ab54286-edd8-4e66-95ab-9fd45b25d9a9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:00.340915 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9ab54286-edd8-4e66-95ab-9fd45b25d9a9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.148672 Dec 18 03:16:00.341475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 311/606] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:00 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:01.357414 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1c3d97ed-b380-4750-9b95-958727ce171d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:01.358053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1c3d97ed-b380-4750-9b95-958727ce171d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:01.364559 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c3d97ed-b380-4750-9b95-958727ce171d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:01.364996 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c3d97ed-b380-4750-9b95-958727ce171d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:01.365958 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c3d97ed-b380-4750-9b95-958727ce171d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:01.366442 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c3d97ed-b380-4750-9b95-958727ce171d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:01.502832 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1c3d97ed-b380-4750-9b95-958727ce171d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:01.511385 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1c3d97ed-b380-4750-9b95-958727ce171d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.157810 Dec 18 03:16:01.511958 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 296/607] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:01 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:02.528402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2e2c377b-89db-4fe9-93f4-c4105d411d93 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:02.529013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2e2c377b-89db-4fe9-93f4-c4105d411d93 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:02.535555 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e2c377b-89db-4fe9-93f4-c4105d411d93 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:02.535997 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e2c377b-89db-4fe9-93f4-c4105d411d93 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:02.536767 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e2c377b-89db-4fe9-93f4-c4105d411d93 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:02.537195 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e2c377b-89db-4fe9-93f4-c4105d411d93 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:02.669316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2e2c377b-89db-4fe9-93f4-c4105d411d93 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:02.677118 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2e2c377b-89db-4fe9-93f4-c4105d411d93 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.152306 Dec 18 03:16:02.677695 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 312/608] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:02 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:03.693838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a47ceee9-c5c3-4e6b-9796-55ee4a1782e1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:03.694518 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a47ceee9-c5c3-4e6b-9796-55ee4a1782e1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:03.704263 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a47ceee9-c5c3-4e6b-9796-55ee4a1782e1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:03.704921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a47ceee9-c5c3-4e6b-9796-55ee4a1782e1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:03.705974 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a47ceee9-c5c3-4e6b-9796-55ee4a1782e1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:03.706461 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a47ceee9-c5c3-4e6b-9796-55ee4a1782e1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:03.842240 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a47ceee9-c5c3-4e6b-9796-55ee4a1782e1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:03.849907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a47ceee9-c5c3-4e6b-9796-55ee4a1782e1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.159689 Dec 18 03:16:03.850462 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 297/609] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:03 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:04.867275 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1c809192-a816-4f35-821f-3b966f1a34d4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:04.867986 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1c809192-a816-4f35-821f-3b966f1a34d4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:04.874518 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c809192-a816-4f35-821f-3b966f1a34d4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:04.874963 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c809192-a816-4f35-821f-3b966f1a34d4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:04.875722 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c809192-a816-4f35-821f-3b966f1a34d4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:04.876148 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c809192-a816-4f35-821f-3b966f1a34d4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:05.006009 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1c809192-a816-4f35-821f-3b966f1a34d4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:05.014211 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1c809192-a816-4f35-821f-3b966f1a34d4 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1566 microversion: 2.1 time: 0.150527 Dec 18 03:16:05.014773 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 313/610] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:04 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:06.030818 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-244bbdd1-583d-4fc5-9f78-a5130f820583 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:06.031430 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-244bbdd1-583d-4fc5-9f78-a5130f820583 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:06.037665 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-244bbdd1-583d-4fc5-9f78-a5130f820583 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:06.038113 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-244bbdd1-583d-4fc5-9f78-a5130f820583 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:06.038885 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-244bbdd1-583d-4fc5-9f78-a5130f820583 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:06.039317 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-244bbdd1-583d-4fc5-9f78-a5130f820583 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:06.170029 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-244bbdd1-583d-4fc5-9f78-a5130f820583 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:06.177750 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-244bbdd1-583d-4fc5-9f78-a5130f820583 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1546 microversion: 2.1 time: 0.150530 Dec 18 03:16:06.178313 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 298/611] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:06 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:06.193947 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-39c633e6-a126-4610-845f-eadeebda91c2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:06.194445 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-39c633e6-a126-4610-845f-eadeebda91c2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:06.200625 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-39c633e6-a126-4610-845f-eadeebda91c2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:06.201072 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-39c633e6-a126-4610-845f-eadeebda91c2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:06.201900 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-39c633e6-a126-4610-845f-eadeebda91c2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:06.202333 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-39c633e6-a126-4610-845f-eadeebda91c2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:06.279290 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-39c633e6-a126-4610-845f-eadeebda91c2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] HTTP exception thrown: Cannot 'detach_volume' instance d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a while it is in vm_state rescued Dec 18 03:16:06.279886 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-39c633e6-a126-4610-845f-eadeebda91c2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Returning 409 to user: Cannot 'detach_volume' instance d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a while it is in vm_state rescued {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:16:06.280702 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-39c633e6-a126-4610-845f-eadeebda91c2 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments/a9719f89-281d-41bb-b7a9-dc0630d2e145" status: 409 len: 152 microversion: 2.1 time: 0.090650 Dec 18 03:16:06.281305 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 314/612] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:16:06 2021] DELETE /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments/a9719f89-281d-41bb-b7a9-dc0630d2e145 => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 18 03:16:06.289291 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d35113df-40af-451a-8168-04c7c01488c1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:06.289851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d35113df-40af-451a-8168-04c7c01488c1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:06.296536 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d35113df-40af-451a-8168-04c7c01488c1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:06.296986 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d35113df-40af-451a-8168-04c7c01488c1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:06.297827 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d35113df-40af-451a-8168-04c7c01488c1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:06.298261 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d35113df-40af-451a-8168-04c7c01488c1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:06.363409 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d35113df-40af-451a-8168-04c7c01488c1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/action" status: 202 len: 0 microversion: 2.1 time: 0.077220 Dec 18 03:16:06.367033 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 299/613] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:16:06 2021] POST /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:16:06.372022 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-aef514d8-c186-4b3a-aceb-7c57012cc1f1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:06.372633 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-aef514d8-c186-4b3a-aceb-7c57012cc1f1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:06.380626 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aef514d8-c186-4b3a-aceb-7c57012cc1f1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:06.381160 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aef514d8-c186-4b3a-aceb-7c57012cc1f1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:06.382124 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aef514d8-c186-4b3a-aceb-7c57012cc1f1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:06.382619 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aef514d8-c186-4b3a-aceb-7c57012cc1f1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:06.531459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-aef514d8-c186-4b3a-aceb-7c57012cc1f1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:06.539163 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-aef514d8-c186-4b3a-aceb-7c57012cc1f1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1554 microversion: 2.1 time: 0.170859 Dec 18 03:16:06.539935 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 315/614] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:06 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:07.556949 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e31a02ad-4a95-4890-a9d9-ec59eb09af27 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:07.557721 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e31a02ad-4a95-4890-a9d9-ec59eb09af27 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:07.565147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e31a02ad-4a95-4890-a9d9-ec59eb09af27 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:07.565596 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e31a02ad-4a95-4890-a9d9-ec59eb09af27 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:07.566413 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e31a02ad-4a95-4890-a9d9-ec59eb09af27 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:07.566848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e31a02ad-4a95-4890-a9d9-ec59eb09af27 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:07.701162 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e31a02ad-4a95-4890-a9d9-ec59eb09af27 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:07.709319 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e31a02ad-4a95-4890-a9d9-ec59eb09af27 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1554 microversion: 2.1 time: 0.156554 Dec 18 03:16:07.709913 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 300/615] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:07 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:08.726914 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-aba28a30-bafb-475b-8466-56ae847add9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:08.727470 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-aba28a30-bafb-475b-8466-56ae847add9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:08.734625 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aba28a30-bafb-475b-8466-56ae847add9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:08.735075 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aba28a30-bafb-475b-8466-56ae847add9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:08.735846 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aba28a30-bafb-475b-8466-56ae847add9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:08.736272 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aba28a30-bafb-475b-8466-56ae847add9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:08.875664 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-aba28a30-bafb-475b-8466-56ae847add9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:08.883536 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-aba28a30-bafb-475b-8466-56ae847add9b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1554 microversion: 2.1 time: 0.160310 Dec 18 03:16:08.884106 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 316/616] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:08 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:09.904068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-486dd01c-c90d-432c-80bd-5cc6336ab78b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:09.904669 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-486dd01c-c90d-432c-80bd-5cc6336ab78b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:09.910981 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-486dd01c-c90d-432c-80bd-5cc6336ab78b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:09.911421 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-486dd01c-c90d-432c-80bd-5cc6336ab78b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:09.912192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-486dd01c-c90d-432c-80bd-5cc6336ab78b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:09.912622 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-486dd01c-c90d-432c-80bd-5cc6336ab78b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:10.049944 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-486dd01c-c90d-432c-80bd-5cc6336ab78b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:10.059546 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-486dd01c-c90d-432c-80bd-5cc6336ab78b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1554 microversion: 2.1 time: 0.159501 Dec 18 03:16:10.060131 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 301/617] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:09 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:11.076256 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5380e588-3082-42f1-b0c1-04100855505f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:11.076909 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5380e588-3082-42f1-b0c1-04100855505f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:11.083934 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5380e588-3082-42f1-b0c1-04100855505f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:11.084522 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5380e588-3082-42f1-b0c1-04100855505f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:11.085931 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5380e588-3082-42f1-b0c1-04100855505f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:11.086530 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5380e588-3082-42f1-b0c1-04100855505f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:11.218797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5380e588-3082-42f1-b0c1-04100855505f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:11.226509 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5380e588-3082-42f1-b0c1-04100855505f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1554 microversion: 2.1 time: 0.154185 Dec 18 03:16:11.227098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 317/618] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:11 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:12.243561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6b83dfa4-93a0-4f5d-a6b2-a2c75fb61d1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:12.244210 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6b83dfa4-93a0-4f5d-a6b2-a2c75fb61d1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:12.252322 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b83dfa4-93a0-4f5d-a6b2-a2c75fb61d1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:12.252771 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b83dfa4-93a0-4f5d-a6b2-a2c75fb61d1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:12.253555 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b83dfa4-93a0-4f5d-a6b2-a2c75fb61d1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:12.254027 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b83dfa4-93a0-4f5d-a6b2-a2c75fb61d1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:12.414959 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-6b83dfa4-93a0-4f5d-a6b2-a2c75fb61d1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:12.427140 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6b83dfa4-93a0-4f5d-a6b2-a2c75fb61d1b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1560 microversion: 2.1 time: 0.187217 Dec 18 03:16:12.427788 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 302/619] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:12 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:16:12.499542 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c7fb2077-8675-458b-8d93-2172336947f9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:12.500231 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c7fb2077-8675-458b-8d93-2172336947f9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:12.506779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c7fb2077-8675-458b-8d93-2172336947f9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:12.507225 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c7fb2077-8675-458b-8d93-2172336947f9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:12.507998 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c7fb2077-8675-458b-8d93-2172336947f9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:12.508435 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c7fb2077-8675-458b-8d93-2172336947f9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:12.586026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-c7fb2077-8675-458b-8d93-2172336947f9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lazy-loading 'services' on Instance uuid d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:16:12.655970 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c7fb2077-8675-458b-8d93-2172336947f9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments/a9719f89-281d-41bb-b7a9-dc0630d2e145" status: 202 len: 0 microversion: 2.1 time: 0.160702 Dec 18 03:16:12.656704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 318/620] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:16:12 2021] DELETE /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments/a9719f89-281d-41bb-b7a9-dc0630d2e145 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:16:12.667028 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fa2bde7f-3de9-4c87-9ee8-3165671c11fb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:12.669155 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-fa2bde7f-3de9-4c87-9ee8-3165671c11fb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:12.676790 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fa2bde7f-3de9-4c87-9ee8-3165671c11fb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:12.677463 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fa2bde7f-3de9-4c87-9ee8-3165671c11fb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:12.678497 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fa2bde7f-3de9-4c87-9ee8-3165671c11fb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:12.679078 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fa2bde7f-3de9-4c87-9ee8-3165671c11fb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:12.715851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-fa2bde7f-3de9-4c87-9ee8-3165671c11fb tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054667 Dec 18 03:16:12.716406 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 303/621] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:16:12 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:16:13.101103 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d6b32268-afc7-4693-ac22-edf940775055 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:13.101927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d6b32268-afc7-4693-ac22-edf940775055 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:13.108417 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6b32268-afc7-4693-ac22-edf940775055 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:13.108862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6b32268-afc7-4693-ac22-edf940775055 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:13.109654 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6b32268-afc7-4693-ac22-edf940775055 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:13.110091 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d6b32268-afc7-4693-ac22-edf940775055 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:13.189485 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-d6b32268-afc7-4693-ac22-edf940775055 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lazy-loading 'services' on Instance uuid 99b5018f-4714-4b42-b899-c27732d501ed {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:16:13.260387 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d6b32268-afc7-4693-ac22-edf940775055 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "DELETE /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed/os-volume_attachments/42dc1326-4604-447f-be04-1a5e0176b534" status: 202 len: 0 microversion: 2.1 time: 0.162990 Dec 18 03:16:13.261047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 319/622] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:16:13 2021] DELETE /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed/os-volume_attachments/42dc1326-4604-447f-be04-1a5e0176b534 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:16:13.727403 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e725ef39-7de7-4010-b5a1-8b4491e740b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:13.728301 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e725ef39-7de7-4010-b5a1-8b4491e740b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:13.734841 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e725ef39-7de7-4010-b5a1-8b4491e740b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:13.735288 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e725ef39-7de7-4010-b5a1-8b4491e740b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:13.736058 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e725ef39-7de7-4010-b5a1-8b4491e740b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:13.736483 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e725ef39-7de7-4010-b5a1-8b4491e740b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:13.767763 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e725ef39-7de7-4010-b5a1-8b4491e740b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Dec 18 03:16:13.768281 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 304/623] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:16:13 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:16:14.780841 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d632ae45-d944-4c24-9aa9-3620718858a6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:14.781846 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d632ae45-d944-4c24-9aa9-3620718858a6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:14.788145 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d632ae45-d944-4c24-9aa9-3620718858a6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:14.788600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d632ae45-d944-4c24-9aa9-3620718858a6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:14.789387 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d632ae45-d944-4c24-9aa9-3620718858a6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:14.789855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d632ae45-d944-4c24-9aa9-3620718858a6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:14.818345 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d632ae45-d944-4c24-9aa9-3620718858a6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042988 Dec 18 03:16:14.818897 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 320/624] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:16:14 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:16:15.420950 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a2828519-b8f5-44e9-aeca-b7b637edb09f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:15.421488 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a2828519-b8f5-44e9-aeca-b7b637edb09f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:15.428079 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a2828519-b8f5-44e9-aeca-b7b637edb09f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:15.428524 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a2828519-b8f5-44e9-aeca-b7b637edb09f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:15.429289 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a2828519-b8f5-44e9-aeca-b7b637edb09f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:15.429741 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a2828519-b8f5-44e9-aeca-b7b637edb09f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:15.458388 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a2828519-b8f5-44e9-aeca-b7b637edb09f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Going to try to terminate instance {{(pid=116000) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:16:15.533081 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a2828519-b8f5-44e9-aeca-b7b637edb09f tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "DELETE /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 204 len: 0 microversion: 2.1 time: 0.115983 Dec 18 03:16:15.533904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 305/625] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:16:15 2021] DELETE /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:16:15.541695 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5c8d1eb9-ecf0-4d90-b386-24364e1c8704 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:15.542305 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5c8d1eb9-ecf0-4d90-b386-24364e1c8704 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:15.549349 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5c8d1eb9-ecf0-4d90-b386-24364e1c8704 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:15.549826 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5c8d1eb9-ecf0-4d90-b386-24364e1c8704 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:15.550601 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5c8d1eb9-ecf0-4d90-b386-24364e1c8704 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:15.551028 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5c8d1eb9-ecf0-4d90-b386-24364e1c8704 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:15.689412 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5c8d1eb9-ecf0-4d90-b386-24364e1c8704 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:15.696865 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5c8d1eb9-ecf0-4d90-b386-24364e1c8704 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1513 microversion: 2.1 time: 0.158836 Dec 18 03:16:15.697421 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 321/626] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:15 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:16.715520 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-00bc3e22-12b8-49d3-bfa0-da77f93b3c03 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:16.716200 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-00bc3e22-12b8-49d3-bfa0-da77f93b3c03 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:16.722438 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-00bc3e22-12b8-49d3-bfa0-da77f93b3c03 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:16.722896 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-00bc3e22-12b8-49d3-bfa0-da77f93b3c03 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:16.723658 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-00bc3e22-12b8-49d3-bfa0-da77f93b3c03 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:16.724086 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-00bc3e22-12b8-49d3-bfa0-da77f93b3c03 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:16.861990 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-00bc3e22-12b8-49d3-bfa0-da77f93b3c03 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:16.869263 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-00bc3e22-12b8-49d3-bfa0-da77f93b3c03 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1513 microversion: 2.1 time: 0.158213 Dec 18 03:16:16.869856 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 306/627] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:16 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:17.122082 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ab30b484-4e5a-4b11-a1ad-16bdf94501f7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:17.122576 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ab30b484-4e5a-4b11-a1ad-16bdf94501f7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:17.128788 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ab30b484-4e5a-4b11-a1ad-16bdf94501f7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:17.129229 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ab30b484-4e5a-4b11-a1ad-16bdf94501f7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:17.130036 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ab30b484-4e5a-4b11-a1ad-16bdf94501f7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:17.130465 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ab30b484-4e5a-4b11-a1ad-16bdf94501f7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:17.156787 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ab30b484-4e5a-4b11-a1ad-16bdf94501f7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:16:17.230887 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ab30b484-4e5a-4b11-a1ad-16bdf94501f7 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 204 len: 0 microversion: 2.1 time: 0.111850 Dec 18 03:16:17.231471 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 322/628] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:16:17 2021] DELETE /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:16:17.239265 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bf5059db-cf6b-4289-adee-ba44595d96b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:17.239883 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bf5059db-cf6b-4289-adee-ba44595d96b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:17.246107 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf5059db-cf6b-4289-adee-ba44595d96b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:17.247093 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf5059db-cf6b-4289-adee-ba44595d96b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:17.253669 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf5059db-cf6b-4289-adee-ba44595d96b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:17.254127 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bf5059db-cf6b-4289-adee-ba44595d96b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:17.389067 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bf5059db-cf6b-4289-adee-ba44595d96b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:17.396483 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bf5059db-cf6b-4289-adee-ba44595d96b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1507 microversion: 2.1 time: 0.160889 Dec 18 03:16:17.397052 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 307/629] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:17 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:17.887888 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-87c57b0f-826e-4eb4-9a60-3ea2bb16864a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:17.888579 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-87c57b0f-826e-4eb4-9a60-3ea2bb16864a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:17.894317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-87c57b0f-826e-4eb4-9a60-3ea2bb16864a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:17.895133 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-87c57b0f-826e-4eb4-9a60-3ea2bb16864a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:17.895916 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-87c57b0f-826e-4eb4-9a60-3ea2bb16864a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:17.896339 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-87c57b0f-826e-4eb4-9a60-3ea2bb16864a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:18.029479 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-87c57b0f-826e-4eb4-9a60-3ea2bb16864a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbac9dd3aff24720b114c16fac5bee71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2332e8c0e55443e4850ccea9e08376d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:18.038435 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-87c57b0f-826e-4eb4-9a60-3ea2bb16864a tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 200 len: 1513 microversion: 2.1 time: 0.155245 Dec 18 03:16:18.039023 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 323/630] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:17 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:18.257523 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-717b115e-db41-4aae-a765-ae753b06edd4 req-fcd1f4d0-7225-4ff4-b3f5-00be58e6fe11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b5018f-4714-4b42-b899-c27732d501ed", "name": "network-vif-deleted", "tag": "a25da932-c153-48ba-b3f3-47beba28720b"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:18.259337 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:16:18.259337 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:16:18.267817 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-717b115e-db41-4aae-a765-ae753b06edd4 req-fcd1f4d0-7225-4ff4-b3f5-00be58e6fe11 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:18.268255 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-717b115e-db41-4aae-a765-ae753b06edd4 req-fcd1f4d0-7225-4ff4-b3f5-00be58e6fe11 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:18.280244 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-717b115e-db41-4aae-a765-ae753b06edd4 req-fcd1f4d0-7225-4ff4-b3f5-00be58e6fe11 service nova] Creating event network-vif-deleted:a25da932-c153-48ba-b3f3-47beba28720b for instance 99b5018f-4714-4b42-b899-c27732d501ed on hv-cinder-81803 Dec 18 03:16:18.285174 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-717b115e-db41-4aae-a765-ae753b06edd4 req-fcd1f4d0-7225-4ff4-b3f5-00be58e6fe11 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031260 Dec 18 03:16:18.285976 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 308/631] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:16:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:16:18.413254 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4549d56c-3c96-4d83-ae5d-ca2f95ca516b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:18.414550 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4549d56c-3c96-4d83-ae5d-ca2f95ca516b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:18.423028 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4549d56c-3c96-4d83-ae5d-ca2f95ca516b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:18.423473 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4549d56c-3c96-4d83-ae5d-ca2f95ca516b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:18.424247 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4549d56c-3c96-4d83-ae5d-ca2f95ca516b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:18.424668 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4549d56c-3c96-4d83-ae5d-ca2f95ca516b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:18.565391 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4549d56c-3c96-4d83-ae5d-ca2f95ca516b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:18.572873 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4549d56c-3c96-4d83-ae5d-ca2f95ca516b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1507 microversion: 2.1 time: 0.163256 Dec 18 03:16:18.573423 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 324/632] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:18 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:19.056757 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-40a78ced-9ac0-48c6-9179-baeb12b688e3 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:19.057489 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-40a78ced-9ac0-48c6-9179-baeb12b688e3 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] [instance: 99b5018f-4714-4b42-b899-c27732d501ed] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:19.064435 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-40a78ced-9ac0-48c6-9179-baeb12b688e3 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:19.064873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-40a78ced-9ac0-48c6-9179-baeb12b688e3 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:19.065659 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-40a78ced-9ac0-48c6-9179-baeb12b688e3 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:19.066152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-40a78ced-9ac0-48c6-9179-baeb12b688e3 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:19.079381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-40a78ced-9ac0-48c6-9179-baeb12b688e3 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] HTTP exception thrown: Instance 99b5018f-4714-4b42-b899-c27732d501ed could not be found. Dec 18 03:16:19.080018 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-40a78ced-9ac0-48c6-9179-baeb12b688e3 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] Returning 404 to user: Instance 99b5018f-4714-4b42-b899-c27732d501ed could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:16:19.080808 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-40a78ced-9ac0-48c6-9179-baeb12b688e3 tempest-VolumesSnapshotTestJSON-1980489681 tempest-VolumesSnapshotTestJSON-1980489681-project] 10.222.0.24 "GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed" status: 404 len: 111 microversion: 2.1 time: 0.028360 Dec 18 03:16:19.081368 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 309/633] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:19 2021] GET /compute/v2.1/servers/99b5018f-4714-4b42-b899-c27732d501ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:16:19.590206 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0830c080-0f77-4a7d-8087-3279b237b279 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:19.590810 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0830c080-0f77-4a7d-8087-3279b237b279 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:19.597294 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0830c080-0f77-4a7d-8087-3279b237b279 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:19.597776 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0830c080-0f77-4a7d-8087-3279b237b279 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:19.598545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0830c080-0f77-4a7d-8087-3279b237b279 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:19.598972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0830c080-0f77-4a7d-8087-3279b237b279 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:19.727099 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0830c080-0f77-4a7d-8087-3279b237b279 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:19.735110 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0830c080-0f77-4a7d-8087-3279b237b279 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1507 microversion: 2.1 time: 0.149071 Dec 18 03:16:19.735664 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 325/634] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:19 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:20.751332 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-39bd5fdf-4795-4c85-b350-bd55b1e230b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:20.752031 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-39bd5fdf-4795-4c85-b350-bd55b1e230b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:20.758432 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-39bd5fdf-4795-4c85-b350-bd55b1e230b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:20.758873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-39bd5fdf-4795-4c85-b350-bd55b1e230b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:20.759644 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-39bd5fdf-4795-4c85-b350-bd55b1e230b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:20.760218 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-39bd5fdf-4795-4c85-b350-bd55b1e230b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:20.967859 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-ff8e3df4-79ae-4f05-81db-41ac17f51262 req-94d632a6-c824-49ee-8d0b-b4031bb8717f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8102ec12-6bb2-46cd-b456-ca768186be97", "name": "network-vif-deleted", "tag": "3ba51193-82e6-4c57-b600-96ad802c4b8f"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:20.969648 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:16:20.969648 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:16:20.978710 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-ff8e3df4-79ae-4f05-81db-41ac17f51262 req-94d632a6-c824-49ee-8d0b-b4031bb8717f service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:20.979454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-ff8e3df4-79ae-4f05-81db-41ac17f51262 req-94d632a6-c824-49ee-8d0b-b4031bb8717f service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:20.992163 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-39bd5fdf-4795-4c85-b350-bd55b1e230b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:20.992554 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-ff8e3df4-79ae-4f05-81db-41ac17f51262 req-94d632a6-c824-49ee-8d0b-b4031bb8717f service nova] Creating event network-vif-deleted:3ba51193-82e6-4c57-b600-96ad802c4b8f for instance 8102ec12-6bb2-46cd-b456-ca768186be97 on hv-cinder-81803 Dec 18 03:16:20.998297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-ff8e3df4-79ae-4f05-81db-41ac17f51262 req-94d632a6-c824-49ee-8d0b-b4031bb8717f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034844 Dec 18 03:16:20.998869 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 326/635] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:16:21.000698 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-39bd5fdf-4795-4c85-b350-bd55b1e230b9 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1507 microversion: 2.1 time: 0.253086 Dec 18 03:16:21.001888 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 310/636] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:20 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:22.018135 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f82b982a-0fe0-4d76-adf2-84413a760ef0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:22.018829 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f82b982a-0fe0-4d76-adf2-84413a760ef0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:22.025206 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f82b982a-0fe0-4d76-adf2-84413a760ef0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:22.025676 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f82b982a-0fe0-4d76-adf2-84413a760ef0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:22.026450 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f82b982a-0fe0-4d76-adf2-84413a760ef0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:22.026877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f82b982a-0fe0-4d76-adf2-84413a760ef0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:22.087820 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f82b982a-0fe0-4d76-adf2-84413a760ef0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:22.096049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f82b982a-0fe0-4d76-adf2-84413a760ef0 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1465 microversion: 2.1 time: 0.081937 Dec 18 03:16:22.096608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 327/637] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:22 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1465 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:23.113125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8c760f75-530b-4782-bc74-bf1f8832d314 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:23.113761 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8c760f75-530b-4782-bc74-bf1f8832d314 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:23.120117 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c760f75-530b-4782-bc74-bf1f8832d314 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:23.120564 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c760f75-530b-4782-bc74-bf1f8832d314 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:23.122400 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c760f75-530b-4782-bc74-bf1f8832d314 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:23.122864 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c760f75-530b-4782-bc74-bf1f8832d314 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:23.185737 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8c760f75-530b-4782-bc74-bf1f8832d314 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:23.193000 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8c760f75-530b-4782-bc74-bf1f8832d314 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1293 microversion: 2.1 time: 0.083634 Dec 18 03:16:23.193514 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 311/638] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:23 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:24.210605 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:24.216316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:24.223026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:24.223468 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:24.224251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:24.224678 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:24.255616 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:24.256060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:24.256496 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lazy-loading 'fault' on Instance uuid 8102ec12-6bb2-46cd-b456-ca768186be97 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:16:24.297732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:24.305047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a6a94bcc-0354-461e-82f8-55cfc5050470 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 200 len: 1312 microversion: 2.1 time: 0.098542 Dec 18 03:16:24.305605 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 328/639] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:24 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:25.322020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e5dfe0b1-92e0-4772-b0c5-52f4fbf620ce tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:25.322629 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e5dfe0b1-92e0-4772-b0c5-52f4fbf620ce tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: 8102ec12-6bb2-46cd-b456-ca768186be97] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:25.329525 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e5dfe0b1-92e0-4772-b0c5-52f4fbf620ce tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.329891 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e5dfe0b1-92e0-4772-b0c5-52f4fbf620ce tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.330747 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e5dfe0b1-92e0-4772-b0c5-52f4fbf620ce tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.331098 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e5dfe0b1-92e0-4772-b0c5-52f4fbf620ce tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.346058 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-e5dfe0b1-92e0-4772-b0c5-52f4fbf620ce tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] HTTP exception thrown: Instance 8102ec12-6bb2-46cd-b456-ca768186be97 could not be found. Dec 18 03:16:25.346645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e5dfe0b1-92e0-4772-b0c5-52f4fbf620ce tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Returning 404 to user: Instance 8102ec12-6bb2-46cd-b456-ca768186be97 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:16:25.347456 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e5dfe0b1-92e0-4772-b0c5-52f4fbf620ce tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97" status: 404 len: 111 microversion: 2.1 time: 0.029099 Dec 18 03:16:25.347993 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 312/640] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:25 2021] GET /compute/v2.1/servers/8102ec12-6bb2-46cd-b456-ca768186be97 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:16:25.355982 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6945949c-ccbc-4183-bbc0-60dfa869f931 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:25.356468 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6945949c-ccbc-4183-bbc0-60dfa869f931 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:25.362660 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6945949c-ccbc-4183-bbc0-60dfa869f931 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.363096 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6945949c-ccbc-4183-bbc0-60dfa869f931 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.363855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6945949c-ccbc-4183-bbc0-60dfa869f931 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.364280 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6945949c-ccbc-4183-bbc0-60dfa869f931 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.388224 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6945949c-ccbc-4183-bbc0-60dfa869f931 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:16:25.460911 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6945949c-ccbc-4183-bbc0-60dfa869f931 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 204 len: 0 microversion: 2.1 time: 0.108539 Dec 18 03:16:25.461589 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 329/641] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:16:25 2021] DELETE /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:16:25.470821 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-625f4170-4864-4ab7-99ee-a9a86311292d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:25.471438 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-625f4170-4864-4ab7-99ee-a9a86311292d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:25.477825 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-625f4170-4864-4ab7-99ee-a9a86311292d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.478272 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-625f4170-4864-4ab7-99ee-a9a86311292d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.479103 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-625f4170-4864-4ab7-99ee-a9a86311292d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.479485 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-625f4170-4864-4ab7-99ee-a9a86311292d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.600442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-82bc62c1-f2da-42ec-90db-192bb57f9264 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:25.600942 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-82bc62c1-f2da-42ec-90db-192bb57f9264 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:25.607792 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-82bc62c1-f2da-42ec-90db-192bb57f9264 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.608247 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-82bc62c1-f2da-42ec-90db-192bb57f9264 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.609022 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-82bc62c1-f2da-42ec-90db-192bb57f9264 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.609454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-82bc62c1-f2da-42ec-90db-192bb57f9264 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.620257 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-625f4170-4864-4ab7-99ee-a9a86311292d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:25.629118 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-625f4170-4864-4ab7-99ee-a9a86311292d tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.161988 Dec 18 03:16:25.629790 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 313/642] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:25 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:16:25.640299 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-82bc62c1-f2da-42ec-90db-192bb57f9264 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments/d9191e04-710d-4173-a6aa-734b5fb69877" status: 200 len: 194 microversion: 2.20 time: 0.044100 Dec 18 03:16:25.640876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 330/643] 10.222.0.24 () {60 vars in 1453 bytes} [Sat Dec 18 03:16:25 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments/d9191e04-710d-4173-a6aa-734b5fb69877 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:16:25.700966 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4f4baf9a-ccac-4fd2-931c-aff5c1274cf6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:25.701446 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4f4baf9a-ccac-4fd2-931c-aff5c1274cf6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:25.707286 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4f4baf9a-ccac-4fd2-931c-aff5c1274cf6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.707727 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4f4baf9a-ccac-4fd2-931c-aff5c1274cf6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.708484 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4f4baf9a-ccac-4fd2-931c-aff5c1274cf6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.708909 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4f4baf9a-ccac-4fd2-931c-aff5c1274cf6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.785429 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-4f4baf9a-ccac-4fd2-931c-aff5c1274cf6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lazy-loading 'services' on Instance uuid aaa82caa-8340-4f50-9989-2ddbc243fb40 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:16:25.853270 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4f4baf9a-ccac-4fd2-931c-aff5c1274cf6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "DELETE /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments/d9191e04-710d-4173-a6aa-734b5fb69877" status: 202 len: 0 microversion: 2.20 time: 0.155787 Dec 18 03:16:25.853797 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 314/644] 10.222.0.24 () {60 vars in 1456 bytes} [Sat Dec 18 03:16:25 2021] DELETE /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments/d9191e04-710d-4173-a6aa-734b5fb69877 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:16:25.862434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b2c010cd-549c-4d08-a957-d43f343e1ecc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:25.863337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b2c010cd-549c-4d08-a957-d43f343e1ecc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:25.869154 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b2c010cd-549c-4d08-a957-d43f343e1ecc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.869638 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b2c010cd-549c-4d08-a957-d43f343e1ecc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.870443 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b2c010cd-549c-4d08-a957-d43f343e1ecc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:25.870895 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b2c010cd-549c-4d08-a957-d43f343e1ecc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:25.901404 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b2c010cd-549c-4d08-a957-d43f343e1ecc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042777 Dec 18 03:16:25.902613 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 331/645] 10.222.0.24 () {60 vars in 1342 bytes} [Sat Dec 18 03:16:25 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:16:26.646637 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2dccd752-cfcd-4052-8b43-f29209021119 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:26.647364 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2dccd752-cfcd-4052-8b43-f29209021119 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:26.653426 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2dccd752-cfcd-4052-8b43-f29209021119 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:26.653899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2dccd752-cfcd-4052-8b43-f29209021119 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:26.654674 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2dccd752-cfcd-4052-8b43-f29209021119 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:26.655113 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2dccd752-cfcd-4052-8b43-f29209021119 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:26.780540 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2dccd752-cfcd-4052-8b43-f29209021119 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:26.788537 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2dccd752-cfcd-4052-8b43-f29209021119 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.146198 Dec 18 03:16:26.789170 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 315/646] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:26 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:26.913816 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-19757b55-1b4f-40a0-92df-5cc80b620a96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:26.914713 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-19757b55-1b4f-40a0-92df-5cc80b620a96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:26.921574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-19757b55-1b4f-40a0-92df-5cc80b620a96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:26.922040 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-19757b55-1b4f-40a0-92df-5cc80b620a96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:26.922801 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-19757b55-1b4f-40a0-92df-5cc80b620a96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:26.923226 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-19757b55-1b4f-40a0-92df-5cc80b620a96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:26.952694 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-19757b55-1b4f-40a0-92df-5cc80b620a96 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042641 Dec 18 03:16:26.953253 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 332/647] 10.222.0.24 () {60 vars in 1342 bytes} [Sat Dec 18 03:16:26 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:16:27.010955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-631ba373-fbdc-4c3d-bd24-406e39d15e22 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:27.011730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-631ba373-fbdc-4c3d-bd24-406e39d15e22 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:27.017577 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-631ba373-fbdc-4c3d-bd24-406e39d15e22 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:27.018187 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-631ba373-fbdc-4c3d-bd24-406e39d15e22 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:27.019191 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-631ba373-fbdc-4c3d-bd24-406e39d15e22 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:27.019651 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-631ba373-fbdc-4c3d-bd24-406e39d15e22 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:27.046800 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-631ba373-fbdc-4c3d-bd24-406e39d15e22 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Going to try to terminate instance {{(pid=116000) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:16:27.119956 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-631ba373-fbdc-4c3d-bd24-406e39d15e22 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "DELETE /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 204 len: 0 microversion: 2.20 time: 0.112432 Dec 18 03:16:27.121202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 316/648] 10.222.0.24 () {60 vars in 1279 bytes} [Sat Dec 18 03:16:27 2021] DELETE /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 03:16:27.130297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:27.130943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:27.145411 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:27.146092 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:27.146891 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:27.147321 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:27.302833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:27.311791 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:27.313263 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:27.314430 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ff1276b5-9e09-4290-9caf-7064940a2c8e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.188439 Dec 18 03:16:27.314978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 333/649] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:27 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:27.807188 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a1194422-9e57-4953-84fd-fad5e0c7e3de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:27.807904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a1194422-9e57-4953-84fd-fad5e0c7e3de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:27.815425 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a1194422-9e57-4953-84fd-fad5e0c7e3de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:27.815867 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a1194422-9e57-4953-84fd-fad5e0c7e3de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:27.816631 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a1194422-9e57-4953-84fd-fad5e0c7e3de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:27.817057 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a1194422-9e57-4953-84fd-fad5e0c7e3de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:27.952642 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a1194422-9e57-4953-84fd-fad5e0c7e3de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:27.961180 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a1194422-9e57-4953-84fd-fad5e0c7e3de tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.157992 Dec 18 03:16:27.961776 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 317/650] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:27 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:28.333643 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:28.334301 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:28.340912 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:28.341348 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:28.342149 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:28.342571 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:28.472457 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:28.482911 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:28.484319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:28.485485 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-02f4497b-51a2-4162-8097-1c6a55e283e7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.155527 Dec 18 03:16:28.486079 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 334/651] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:28 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:28.980301 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e535b64a-f023-49aa-bf40-56bf8bc02bd1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:28.980920 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e535b64a-f023-49aa-bf40-56bf8bc02bd1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:28.987272 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e535b64a-f023-49aa-bf40-56bf8bc02bd1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:28.987716 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e535b64a-f023-49aa-bf40-56bf8bc02bd1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:28.988488 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e535b64a-f023-49aa-bf40-56bf8bc02bd1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:28.988922 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e535b64a-f023-49aa-bf40-56bf8bc02bd1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:29.115952 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e535b64a-f023-49aa-bf40-56bf8bc02bd1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:29.124087 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e535b64a-f023-49aa-bf40-56bf8bc02bd1 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.148014 Dec 18 03:16:29.124650 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 318/652] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:28 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:29.504208 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:29.504738 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:29.511548 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:29.512120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:29.512891 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:29.513317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:29.642000 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:29.649783 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:29.651264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:29.653052 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2bdc4c10-e059-4ed7-a94a-457f5a39a6ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.152545 Dec 18 03:16:29.653593 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 335/653] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:29 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:30.140797 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7d69f87c-b343-4c98-a252-8ef6fd77088b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:30.141411 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7d69f87c-b343-4c98-a252-8ef6fd77088b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:30.147649 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d69f87c-b343-4c98-a252-8ef6fd77088b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:30.148096 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d69f87c-b343-4c98-a252-8ef6fd77088b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:30.148865 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d69f87c-b343-4c98-a252-8ef6fd77088b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:30.149292 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d69f87c-b343-4c98-a252-8ef6fd77088b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:30.279313 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7d69f87c-b343-4c98-a252-8ef6fd77088b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:30.286518 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7d69f87c-b343-4c98-a252-8ef6fd77088b tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.149357 Dec 18 03:16:30.287144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 319/654] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:30 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:30.671349 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:30.671963 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:30.677907 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:30.678359 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:30.679134 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:30.679565 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:30.806423 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:30.815026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:30.816484 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:30.817772 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0791c6e0-f06a-4deb-9c53-88573da4ce25 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.150726 Dec 18 03:16:30.818321 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 336/655] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:30 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:31.302534 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8196aa2e-8034-409d-8da1-1fc5b02386dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:31.303213 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8196aa2e-8034-409d-8da1-1fc5b02386dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:31.309376 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8196aa2e-8034-409d-8da1-1fc5b02386dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:31.309852 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8196aa2e-8034-409d-8da1-1fc5b02386dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:31.310617 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8196aa2e-8034-409d-8da1-1fc5b02386dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:31.311045 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8196aa2e-8034-409d-8da1-1fc5b02386dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:31.443826 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8196aa2e-8034-409d-8da1-1fc5b02386dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:31.451712 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8196aa2e-8034-409d-8da1-1fc5b02386dd tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.152679 Dec 18 03:16:31.452305 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 320/656] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:31 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:31.835755 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:31.836355 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:31.843410 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:31.843855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:31.844624 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:31.845050 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:31.971322 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:31.978993 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:31.980747 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:31.981938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1c8e6b84-9069-467e-a890-33c181af4bfe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.149823 Dec 18 03:16:31.982493 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 337/657] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:31 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:32.468609 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b3e3fe19-493c-46f8-bbe8-b2fefca33103 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:32.469243 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b3e3fe19-493c-46f8-bbe8-b2fefca33103 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:32.475574 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3e3fe19-493c-46f8-bbe8-b2fefca33103 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:32.476038 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3e3fe19-493c-46f8-bbe8-b2fefca33103 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:32.476808 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3e3fe19-493c-46f8-bbe8-b2fefca33103 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:32.477234 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3e3fe19-493c-46f8-bbe8-b2fefca33103 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:32.687361 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b3e3fe19-493c-46f8-bbe8-b2fefca33103 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:32.694795 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b3e3fe19-493c-46f8-bbe8-b2fefca33103 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1520 microversion: 2.1 time: 0.230458 Dec 18 03:16:32.695537 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 321/658] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:32 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:33.001275 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:33.002069 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:33.010119 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:33.011660 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:33.012995 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:33.013598 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:33.236751 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:33.244614 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:33.247119 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:33.248361 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-fcef2d41-516c-41ee-80c3-6ffa2e133b5d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1724 microversion: 2.20 time: 0.251145 Dec 18 03:16:33.261009 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 338/659] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:32 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:33.332278 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-32238e32-d4ca-4333-beac-a0685c36a51d req-77fdcffc-521d-4227-8e56-f4cbeb314177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a", "name": "network-vif-deleted", "tag": "86a51a4c-eba1-4460-a8c6-1adb483f5473"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:33.334016 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:16:33.334016 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:16:33.341045 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-32238e32-d4ca-4333-beac-a0685c36a51d req-77fdcffc-521d-4227-8e56-f4cbeb314177 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:33.341488 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-32238e32-d4ca-4333-beac-a0685c36a51d req-77fdcffc-521d-4227-8e56-f4cbeb314177 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:33.352693 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-32238e32-d4ca-4333-beac-a0685c36a51d req-77fdcffc-521d-4227-8e56-f4cbeb314177 service nova] Creating event network-vif-deleted:86a51a4c-eba1-4460-a8c6-1adb483f5473 for instance d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a on hv-cinder-81803 Dec 18 03:16:33.358365 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-32238e32-d4ca-4333-beac-a0685c36a51d req-77fdcffc-521d-4227-8e56-f4cbeb314177 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029726 Dec 18 03:16:33.359356 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 322/660] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:16:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:16:33.711888 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:33.712531 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:33.719172 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:33.719683 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:33.720459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:33.720887 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:33.759103 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:33.759814 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:33.760262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lazy-loading 'fault' on Instance uuid d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:16:33.817087 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-9e6c4515-bdae-48e7-a536-2e7f31d2e05c req-d91d7fe8-d03a-4b6b-985d-be6846492f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa82caa-8340-4f50-9989-2ddbc243fb40", "name": "network-vif-deleted", "tag": "b9de074c-64ba-4630-b439-f53e09e04d4b"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:33.818863 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:16:33.818863 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:16:33.826713 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e7790b3fa743b084df1079d1916138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502652af86344b828a769149c2964636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:33.836705 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-9e6c4515-bdae-48e7-a536-2e7f31d2e05c req-d91d7fe8-d03a-4b6b-985d-be6846492f35 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:33.838769 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-9e6c4515-bdae-48e7-a536-2e7f31d2e05c req-d91d7fe8-d03a-4b6b-985d-be6846492f35 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:33.841722 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-80571e5f-866c-43fc-b907-d9e983e8e36f tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 200 len: 1311 microversion: 2.1 time: 0.133437 Dec 18 03:16:33.850096 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 339/661] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:33 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:16:33.857396 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-9e6c4515-bdae-48e7-a536-2e7f31d2e05c req-d91d7fe8-d03a-4b6b-985d-be6846492f35 service nova] Creating event network-vif-deleted:b9de074c-64ba-4630-b439-f53e09e04d4b for instance aaa82caa-8340-4f50-9989-2ddbc243fb40 on hv-cinder-81803 Dec 18 03:16:33.864988 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-9e6c4515-bdae-48e7-a536-2e7f31d2e05c req-d91d7fe8-d03a-4b6b-985d-be6846492f35 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053889 Dec 18 03:16:33.865581 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 323/662] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:16:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:16:34.267848 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:34.269021 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:34.276256 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:34.277994 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:34.279182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:34.279633 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:34.312145 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:34.312954 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:34.313612 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lazy-loading 'fault' on Instance uuid aaa82caa-8340-4f50-9989-2ddbc243fb40 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:16:34.361605 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:34.369875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:34.372823 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:34.374236 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-014d745b-79f5-439e-bdca-5887f93b7201 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 200 len: 1372 microversion: 2.20 time: 0.110183 Dec 18 03:16:34.374968 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 340/663] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:34 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:34.861781 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-755f262e-ec27-4422-bf1a-3727d97e19f6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:34.862468 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-755f262e-ec27-4422-bf1a-3727d97e19f6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] [instance: d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:34.868907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-755f262e-ec27-4422-bf1a-3727d97e19f6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:34.869349 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-755f262e-ec27-4422-bf1a-3727d97e19f6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:34.870195 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-755f262e-ec27-4422-bf1a-3727d97e19f6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:34.872052 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-755f262e-ec27-4422-bf1a-3727d97e19f6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:34.886418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-755f262e-ec27-4422-bf1a-3727d97e19f6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] HTTP exception thrown: Instance d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a could not be found. Dec 18 03:16:34.887019 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-755f262e-ec27-4422-bf1a-3727d97e19f6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] Returning 404 to user: Instance d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:16:34.887833 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-755f262e-ec27-4422-bf1a-3727d97e19f6 tempest-ServerRescueNegativeTestJSON-1677294265 tempest-ServerRescueNegativeTestJSON-1677294265-project] 10.222.0.24 "GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a" status: 404 len: 111 microversion: 2.1 time: 0.031339 Dec 18 03:16:34.888374 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 324/664] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:16:34 2021] GET /compute/v2.1/servers/d9a5acfa-dfa7-4cf0-a48a-f6b6f59a929a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:16:35.393137 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bb372c7c-72c4-44b1-bbe0-9f34c3d5176a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:35.393648 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bb372c7c-72c4-44b1-bbe0-9f34c3d5176a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:35.404901 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb372c7c-72c4-44b1-bbe0-9f34c3d5176a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:35.405732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb372c7c-72c4-44b1-bbe0-9f34c3d5176a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:35.406731 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb372c7c-72c4-44b1-bbe0-9f34c3d5176a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:35.407367 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb372c7c-72c4-44b1-bbe0-9f34c3d5176a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:35.431605 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-bb372c7c-72c4-44b1-bbe0-9f34c3d5176a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] HTTP exception thrown: Instance aaa82caa-8340-4f50-9989-2ddbc243fb40 could not be found. Dec 18 03:16:35.432565 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bb372c7c-72c4-44b1-bbe0-9f34c3d5176a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Returning 404 to user: Instance aaa82caa-8340-4f50-9989-2ddbc243fb40 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:16:35.433667 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bb372c7c-72c4-44b1-bbe0-9f34c3d5176a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 404 len: 111 microversion: 2.20 time: 0.045121 Dec 18 03:16:35.434198 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 341/665] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:35 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:16:35.442165 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-dfe54d75-eb4b-4682-8488-67cde79e7349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '.version_select at 0x7fad2633c940>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:35.462439 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-dfe54d75-eb4b-4682-8488-67cde79e7349 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204234000" status: 204 len: 0 microversion: 2.20 time: 0.023620 Dec 18 03:16:35.463007 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 325/666] 10.222.0.24 () {60 vars in 1261 bytes} [Sat Dec 18 03:16:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204234000 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 03:16:36.207995 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8d417257-64ea-4b9e-86ce-b38763a05357 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'create', calling method: .version_select at 0x7fad26b13160>, body: {"keypair": {"name": "tempest-keypair-1459014602"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:36.229011 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-8d417257-64ea-4b9e-86ce-b38763a05357 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for project 9f27614e91de40f2ba636e557961e94f. Resources: {'key_pairs'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:16:36.233930 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-8d417257-64ea-4b9e-86ce-b38763a05357 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for user eab89208d73e45878ea797026c7741f8 and project 9f27614e91de40f2ba636e557961e94f. Resources: {'key_pairs'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:16:36.415569 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-8d417257-64ea-4b9e-86ce-b38763a05357 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for project 9f27614e91de40f2ba636e557961e94f. Resources: {'key_pairs'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:16:36.420238 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-8d417257-64ea-4b9e-86ce-b38763a05357 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for user eab89208d73e45878ea797026c7741f8 and project 9f27614e91de40f2ba636e557961e94f. Resources: {'key_pairs'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:16:36.438309 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8d417257-64ea-4b9e-86ce-b38763a05357 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.235454 Dec 18 03:16:36.439262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 342/667] 10.222.0.24 () {62 vars in 1198 bytes} [Sat Dec 18 03:16:36 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 238 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 18 03:16:38.390885 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1924007019", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c2dc738-d6f1-48f3-b8e0-871e485e797e"}], "security_groups": [{"name": "tempest-securitygroup--1925403114"}], "key_name": "tempest-keypair-1459014602", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:38.502634 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] validate_networks() for [('9c2dc738-d6f1-48f3-b8e0-871e485e797e', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:16:38.905381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:16:38.905868 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:16:38.907456 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:16:38.907667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:16:38.908190 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:16:38.917935 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:38.918507 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:38.919328 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:38.919763 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:38.938630 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for project 9f27614e91de40f2ba636e557961e94f. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:16:38.942917 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Getting quotas for user eab89208d73e45878ea797026c7741f8 and project 9f27614e91de40f2ba636e557961e94f. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:16:38.955865 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:16:38.958309 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:16:39.009647 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-64a4987b-9202-4977-a6c7-4d853af5bfea tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.624473 Dec 18 03:16:39.010402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 326/668] 10.222.0.24 () {62 vars in 1187 bytes} [Sat Dec 18 03:16:38 2021] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 18 03:16:39.025020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8c85dc64-8f8e-49cc-a4fd-2642a3bdddc2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:39.025791 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8c85dc64-8f8e-49cc-a4fd-2642a3bdddc2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:39.099601 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8c85dc64-8f8e-49cc-a4fd-2642a3bdddc2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:39.107634 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8c85dc64-8f8e-49cc-a4fd-2642a3bdddc2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:39.110232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8c85dc64-8f8e-49cc-a4fd-2642a3bdddc2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:39.111544 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8c85dc64-8f8e-49cc-a4fd-2642a3bdddc2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1282 microversion: 2.20 time: 0.092752 Dec 18 03:16:39.112092 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 343/669] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:39 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:40.132774 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:40.133576 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:40.145138 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:40.147476 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:40.150905 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:40.151920 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:40.240560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:40.249077 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:40.251043 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:40.252343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-88efa395-d789-4fbb-ab10-31b7db1a425b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1352 microversion: 2.20 time: 0.123611 Dec 18 03:16:40.253017 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 327/670] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:40 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:41.270833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:41.271435 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:41.277811 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:41.278256 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:41.279026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:41.279452 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:41.408688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:41.416663 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:41.419417 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:41.420523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b0802967-4f24-40e5-9851-160cda9538d4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.153428 Dec 18 03:16:41.421075 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 344/671] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:41 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:42.439054 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:42.439592 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:42.445928 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:42.446370 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:42.447147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:42.447594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:42.577792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:42.585438 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:42.586950 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:42.588041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-22e2876c-b94f-40d2-ae8d-75bc7dfd73b0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.152740 Dec 18 03:16:42.588594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 328/672] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:42 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:43.607043 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:43.607640 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:43.614104 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:43.614484 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:43.615251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:43.615672 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:43.751574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:43.770472 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:43.772912 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:43.774032 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9921912a-82b8-4434-aede-255f4c7ff3fc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.171542 Dec 18 03:16:43.774577 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 345/673] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:43 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:16:44.091666 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-5cc764bd-b64c-4888-a127-1821d14eb3d1 req-d6dcd504-34b6-4af5-8786-a1e8e6fc040d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ea4525-cf68-4ac8-9908-4857fde99da8", "tag": "9d73aaca-823a-46a8-a166-0001e8e95857"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:44.094423 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:16:44.094423 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:16:44.104019 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-5cc764bd-b64c-4888-a127-1821d14eb3d1 req-d6dcd504-34b6-4af5-8786-a1e8e6fc040d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:44.105685 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-5cc764bd-b64c-4888-a127-1821d14eb3d1 req-d6dcd504-34b6-4af5-8786-a1e8e6fc040d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:44.124839 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-5cc764bd-b64c-4888-a127-1821d14eb3d1 req-d6dcd504-34b6-4af5-8786-a1e8e6fc040d service nova] Creating event network-changed:9d73aaca-823a-46a8-a166-0001e8e95857 for instance d6ea4525-cf68-4ac8-9908-4857fde99da8 on hv-cinder-81803 Dec 18 03:16:44.130486 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-5cc764bd-b64c-4888-a127-1821d14eb3d1 req-d6dcd504-34b6-4af5-8786-a1e8e6fc040d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043484 Dec 18 03:16:44.131091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 329/674] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:16:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:16:44.793216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:44.793991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:44.799951 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:44.800396 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:44.801418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:44.802085 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:45.021844 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:45.030544 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:45.032078 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:45.033174 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-46e49d02-9b16-456d-93fe-d1a1cc6aebc5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.244810 Dec 18 03:16:45.033760 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 346/675] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:44 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:46.052883 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:46.053675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:46.059849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:46.060386 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:46.061231 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:46.061779 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:46.195337 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:46.203367 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:46.204849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:46.205966 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-45c8232c-21f0-410b-812c-bf2f1d618617 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.157704 Dec 18 03:16:46.206523 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 330/676] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:46 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:47.223949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:47.224484 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:47.231124 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:47.231565 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:47.232336 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:47.232770 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:47.374765 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:47.384494 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:47.386946 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:47.388495 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9795499b-c7ff-40d4-8d8b-db1298985a09 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.168406 Dec 18 03:16:47.389057 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 347/677] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:47 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:48.407839 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:48.409077 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:48.422836 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:48.423373 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:48.424224 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:48.424716 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:48.569449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:48.578695 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:48.580656 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:48.582741 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a3fae4e5-3d72-4491-83ab-406a990be2bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.179382 Dec 18 03:16:48.593921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 331/678] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:48 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:49.600584 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:49.601178 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:49.607422 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:49.607860 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:49.608623 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:49.609047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:49.736191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:49.743671 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:49.745153 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:49.746262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3ab4e625-0744-4f1a-b3f5-d145838cf7e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.149342 Dec 18 03:16:49.746807 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 348/679] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:49 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:16:50.764595 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:50.765311 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:50.771250 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:50.771683 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:50.772456 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:50.772881 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:50.905220 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:50.913902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:50.915410 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:50.916547 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e19cd154-519a-47fb-bc37-0247f7dd4a9b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.156306 Dec 18 03:16:50.917163 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 332/680] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:50 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:51.934817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:51.935367 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:51.941870 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:51.942371 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:51.943146 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:51.943584 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:52.076656 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:52.084482 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:52.086419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:52.087758 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-932a3567-ead2-4269-b4b2-d1856d26bc51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.157258 Dec 18 03:16:52.098618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 349/681] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:51 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:53.106612 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:53.107220 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:53.113376 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:53.113849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:53.114617 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:53.115043 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:53.244174 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:53.252266 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:53.253765 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:53.254846 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-557d7d85-20aa-4b38-a757-79e993b934bc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.152851 Dec 18 03:16:53.255410 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 333/682] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:53 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:16:54.272247 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:54.272855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:54.280743 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:54.281189 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:54.282029 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:54.282465 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:54.411931 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:54.419659 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:54.421121 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:54.422223 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4f10d28c-bfc8-48d1-b58f-f273d4e6e355 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.153721 Dec 18 03:16:54.422772 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 350/683] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:54 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:54.975474 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-dd21aea4-70c7-4915-a5ec-f6f1bb598575 req-48b715bc-afc9-439a-a8b0-12bbc7eb13de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ea4525-cf68-4ac8-9908-4857fde99da8", "name": "network-vif-plugged", "status": "completed", "tag": "9d73aaca-823a-46a8-a166-0001e8e95857"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:54.977120 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:16:54.977120 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:16:54.985430 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-dd21aea4-70c7-4915-a5ec-f6f1bb598575 req-48b715bc-afc9-439a-a8b0-12bbc7eb13de service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:54.986013 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-dd21aea4-70c7-4915-a5ec-f6f1bb598575 req-48b715bc-afc9-439a-a8b0-12bbc7eb13de service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:54.997541 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-dd21aea4-70c7-4915-a5ec-f6f1bb598575 req-48b715bc-afc9-439a-a8b0-12bbc7eb13de service nova] Creating event network-vif-plugged:9d73aaca-823a-46a8-a166-0001e8e95857 for instance d6ea4525-cf68-4ac8-9908-4857fde99da8 on hv-cinder-81803 Dec 18 03:16:55.002512 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-dd21aea4-70c7-4915-a5ec-f6f1bb598575 req-48b715bc-afc9-439a-a8b0-12bbc7eb13de service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030617 Dec 18 03:16:55.003262 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 334/684] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:16:55.440155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:55.440763 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:55.447077 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:55.447518 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:55.448414 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:55.448840 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:55.578436 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:55.586467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:55.588063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:55.589775 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d8d0a347-674f-4295-bea8-65642f3e7028 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.153332 Dec 18 03:16:55.590336 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 351/685] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:55 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:56.608588 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:56.609286 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:56.615777 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:56.616221 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:56.616994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:56.617455 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:56.754784 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:56.763519 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:56.764992 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:56.766110 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3f6f88be-aae7-4190-a98d-bdd26188ae72 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1408 microversion: 2.20 time: 0.162376 Dec 18 03:16:56.766656 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 335/686] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:56 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:57.784150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:57.784685 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:57.790997 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:57.791436 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:57.793011 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:57.793443 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:57.921289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:57.929226 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:57.930746 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:16:57.931883 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-254345c7-4d4f-4ce4-b5d3-04c566402e83 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1600 microversion: 2.20 time: 0.151471 Dec 18 03:16:57.932446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 352/687] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:16:57 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:16:57.949143 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-aafde9cc-485c-4772-9c2d-28f4ed276fe4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:16:57.949817 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-aafde9cc-485c-4772-9c2d-28f4ed276fe4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:57.956230 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aafde9cc-485c-4772-9c2d-28f4ed276fe4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:57.956678 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aafde9cc-485c-4772-9c2d-28f4ed276fe4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:57.957461 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aafde9cc-485c-4772-9c2d-28f4ed276fe4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:57.957926 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aafde9cc-485c-4772-9c2d-28f4ed276fe4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:58.036974 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-aafde9cc-485c-4772-9c2d-28f4ed276fe4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091700 Dec 18 03:16:58.037569 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 336/688] 10.222.0.24 () {60 vars in 1315 bytes} [Sat Dec 18 03:16:57 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:16:59.213424 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3df47ca2-1ac1-44b9-a2fb-2e98b62fd0dc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:59.214966 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3df47ca2-1ac1-44b9-a2fb-2e98b62fd0dc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:16:59.217707 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-02402191-5b8a-453c-8931-c1f067d7c9ee req-8dd6585d-152a-4eba-a52d-e9a7ce3611c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ea4525-cf68-4ac8-9908-4857fde99da8", "tag": "9d73aaca-823a-46a8-a166-0001e8e95857"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:16:59.219532 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:16:59.219532 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:16:59.221542 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3df47ca2-1ac1-44b9-a2fb-2e98b62fd0dc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:59.222152 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3df47ca2-1ac1-44b9-a2fb-2e98b62fd0dc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:59.222934 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3df47ca2-1ac1-44b9-a2fb-2e98b62fd0dc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:59.223376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3df47ca2-1ac1-44b9-a2fb-2e98b62fd0dc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:59.227277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-02402191-5b8a-453c-8931-c1f067d7c9ee req-8dd6585d-152a-4eba-a52d-e9a7ce3611c1 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:16:59.227983 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-02402191-5b8a-453c-8931-c1f067d7c9ee req-8dd6585d-152a-4eba-a52d-e9a7ce3611c1 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:16:59.239962 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-02402191-5b8a-453c-8931-c1f067d7c9ee req-8dd6585d-152a-4eba-a52d-e9a7ce3611c1 service nova] Creating event network-changed:9d73aaca-823a-46a8-a166-0001e8e95857 for instance d6ea4525-cf68-4ac8-9908-4857fde99da8 on hv-cinder-81803 Dec 18 03:16:59.244931 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-02402191-5b8a-453c-8931-c1f067d7c9ee req-8dd6585d-152a-4eba-a52d-e9a7ce3611c1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032121 Dec 18 03:16:59.246023 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 337/689] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:16:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:17:00.195773 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3df47ca2-1ac1-44b9-a2fb-2e98b62fd0dc tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 14 microversion: 2.20 time: 0.985840 Dec 18 03:17:00.196673 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 353/690] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:16:59 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 14 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:17:01.207022 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bbb2ed6a-4d61-4515-b994-7585caba2ae3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:01.208030 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bbb2ed6a-4d61-4515-b994-7585caba2ae3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:01.214780 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbb2ed6a-4d61-4515-b994-7585caba2ae3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:01.215238 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbb2ed6a-4d61-4515-b994-7585caba2ae3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:01.216025 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbb2ed6a-4d61-4515-b994-7585caba2ae3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:01.216456 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bbb2ed6a-4d61-4515-b994-7585caba2ae3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:01.296330 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bbb2ed6a-4d61-4515-b994-7585caba2ae3 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 14 microversion: 2.20 time: 0.093572 Dec 18 03:17:01.299727 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 338/691] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:01 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:02.308018 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-dc249b0c-9b08-495b-ad6d-8ce24cbc65f8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:02.309175 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-dc249b0c-9b08-495b-ad6d-8ce24cbc65f8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:02.316001 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dc249b0c-9b08-495b-ad6d-8ce24cbc65f8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:02.316447 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dc249b0c-9b08-495b-ad6d-8ce24cbc65f8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:02.317219 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dc249b0c-9b08-495b-ad6d-8ce24cbc65f8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:02.317667 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dc249b0c-9b08-495b-ad6d-8ce24cbc65f8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:02.403026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-dc249b0c-9b08-495b-ad6d-8ce24cbc65f8 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 14 microversion: 2.20 time: 0.099421 Dec 18 03:17:02.406290 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 354/692] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:02 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:03.413392 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cdcc362e-8167-4c6e-8c3a-b373ca70dbc6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:03.414454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cdcc362e-8167-4c6e-8c3a-b373ca70dbc6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:03.421589 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cdcc362e-8167-4c6e-8c3a-b373ca70dbc6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:03.421895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cdcc362e-8167-4c6e-8c3a-b373ca70dbc6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:03.422668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cdcc362e-8167-4c6e-8c3a-b373ca70dbc6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:03.423103 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cdcc362e-8167-4c6e-8c3a-b373ca70dbc6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:03.515765 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cdcc362e-8167-4c6e-8c3a-b373ca70dbc6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 14 microversion: 2.20 time: 0.106233 Dec 18 03:17:03.516550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 339/693] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:03 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:04.527122 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b14b85f3-dd27-48b7-b589-1b6aef5c967a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:04.528834 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b14b85f3-dd27-48b7-b589-1b6aef5c967a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:04.536058 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b14b85f3-dd27-48b7-b589-1b6aef5c967a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:04.536494 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b14b85f3-dd27-48b7-b589-1b6aef5c967a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:04.537252 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b14b85f3-dd27-48b7-b589-1b6aef5c967a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:04.537704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b14b85f3-dd27-48b7-b589-1b6aef5c967a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:04.616762 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b14b85f3-dd27-48b7-b589-1b6aef5c967a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 14 microversion: 2.20 time: 0.093417 Dec 18 03:17:04.617404 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 355/694] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:04 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:05.628855 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-582f2029-1544-4e2e-8877-69d0d6236df2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:05.629883 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-582f2029-1544-4e2e-8877-69d0d6236df2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:05.636746 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-582f2029-1544-4e2e-8877-69d0d6236df2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:05.637238 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-582f2029-1544-4e2e-8877-69d0d6236df2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:05.638358 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-582f2029-1544-4e2e-8877-69d0d6236df2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:05.638792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-582f2029-1544-4e2e-8877-69d0d6236df2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:05.715523 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-582f2029-1544-4e2e-8877-69d0d6236df2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 14 microversion: 2.20 time: 0.090601 Dec 18 03:17:05.716118 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 340/695] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:05 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:06.727051 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1a569808-524b-48fa-96c2-29501d738627 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:06.728685 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1a569808-524b-48fa-96c2-29501d738627 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:06.736387 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a569808-524b-48fa-96c2-29501d738627 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:06.736859 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a569808-524b-48fa-96c2-29501d738627 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:06.737653 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a569808-524b-48fa-96c2-29501d738627 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:06.738085 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a569808-524b-48fa-96c2-29501d738627 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:06.835561 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1a569808-524b-48fa-96c2-29501d738627 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 14 microversion: 2.20 time: 0.112578 Dec 18 03:17:06.836634 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 356/696] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:06 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:07.847357 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-25b886f8-c2c7-44ab-9398-1e3e9cb7780c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:07.848619 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-25b886f8-c2c7-44ab-9398-1e3e9cb7780c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:07.855636 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-25b886f8-c2c7-44ab-9398-1e3e9cb7780c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:07.856570 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-25b886f8-c2c7-44ab-9398-1e3e9cb7780c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:07.857361 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-25b886f8-c2c7-44ab-9398-1e3e9cb7780c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:07.857945 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-25b886f8-c2c7-44ab-9398-1e3e9cb7780c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:07.952467 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-25b886f8-c2c7-44ab-9398-1e3e9cb7780c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 14 microversion: 2.20 time: 0.109127 Dec 18 03:17:07.955675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 341/697] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:07 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:08.965026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0d9c8a70-bf94-4621-af5e-5a163abc25ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:08.966425 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0d9c8a70-bf94-4621-af5e-5a163abc25ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:08.977608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0d9c8a70-bf94-4621-af5e-5a163abc25ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:08.978158 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0d9c8a70-bf94-4621-af5e-5a163abc25ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:08.978976 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0d9c8a70-bf94-4621-af5e-5a163abc25ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:08.979410 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0d9c8a70-bf94-4621-af5e-5a163abc25ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:09.063021 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0d9c8a70-bf94-4621-af5e-5a163abc25ad tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 14 microversion: 2.20 time: 0.102202 Dec 18 03:17:09.063971 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 357/698] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:08 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:10.093215 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7583f87d-a8ef-47f4-bf3e-d1d1a599bc7b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:10.096195 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7583f87d-a8ef-47f4-bf3e-d1d1a599bc7b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:10.107436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7583f87d-a8ef-47f4-bf3e-d1d1a599bc7b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:10.110142 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7583f87d-a8ef-47f4-bf3e-d1d1a599bc7b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:10.112080 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7583f87d-a8ef-47f4-bf3e-d1d1a599bc7b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:10.114690 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7583f87d-a8ef-47f4-bf3e-d1d1a599bc7b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:10.238845 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7583f87d-a8ef-47f4-bf3e-d1d1a599bc7b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 13651 microversion: 2.20 time: 0.167105 Dec 18 03:17:10.242897 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 342/699] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:10 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 13651 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:11.252609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-67667fd5-1fb8-468e-abd9-e3f97533d473 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:11.253547 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-67667fd5-1fb8-468e-abd9-e3f97533d473 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:11.260362 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67667fd5-1fb8-468e-abd9-e3f97533d473 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:11.260809 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67667fd5-1fb8-468e-abd9-e3f97533d473 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:11.261585 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67667fd5-1fb8-468e-abd9-e3f97533d473 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:11.262611 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-67667fd5-1fb8-468e-abd9-e3f97533d473 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:12.350755 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:17:12.351379 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: Sat Dec 18 03:17:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action (ip 10.222.0.24) !!! Dec 18 03:17:13.129350 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-67667fd5-1fb8-468e-abd9-e3f97533d473 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 21457 microversion: 2.20 time: 1.882357 Dec 18 03:17:13.130535 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 358/700] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:11 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 21457 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:14.141712 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c849c8f4-847f-49f2-8a8e-991ab86d5f39 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:14.142659 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c849c8f4-847f-49f2-8a8e-991ab86d5f39 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:14.149048 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c849c8f4-847f-49f2-8a8e-991ab86d5f39 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:14.149491 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c849c8f4-847f-49f2-8a8e-991ab86d5f39 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:14.150305 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c849c8f4-847f-49f2-8a8e-991ab86d5f39 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:14.150739 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c849c8f4-847f-49f2-8a8e-991ab86d5f39 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:16.131892 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c849c8f4-847f-49f2-8a8e-991ab86d5f39 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 25556 microversion: 2.20 time: 1.994075 Dec 18 03:17:16.132623 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 343/701] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:14 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 25556 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:17.146772 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1a99b5f4-570e-4443-8c7d-73c9baa0568c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:17.149419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1a99b5f4-570e-4443-8c7d-73c9baa0568c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:17.157603 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a99b5f4-570e-4443-8c7d-73c9baa0568c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:17.158242 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a99b5f4-570e-4443-8c7d-73c9baa0568c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:17.159104 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a99b5f4-570e-4443-8c7d-73c9baa0568c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:17.159611 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1a99b5f4-570e-4443-8c7d-73c9baa0568c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:17.261315 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1a99b5f4-570e-4443-8c7d-73c9baa0568c tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 26961 microversion: 2.20 time: 0.120314 Dec 18 03:17:17.262862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 359/702] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:17 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 26961 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:18.274554 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a6b3f0b0-f69f-406d-a746-7c8f663e238f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:18.275606 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a6b3f0b0-f69f-406d-a746-7c8f663e238f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:18.286449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a6b3f0b0-f69f-406d-a746-7c8f663e238f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:18.287233 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a6b3f0b0-f69f-406d-a746-7c8f663e238f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:18.288027 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a6b3f0b0-f69f-406d-a746-7c8f663e238f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:18.288458 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a6b3f0b0-f69f-406d-a746-7c8f663e238f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:18.408537 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a6b3f0b0-f69f-406d-a746-7c8f663e238f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 27700 microversion: 2.20 time: 0.137745 Dec 18 03:17:18.411898 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 344/703] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:18 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 27700 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:19.780240 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a21fa3e7-df19-4281-a16e-b67a04a9aef7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:19.784312 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a21fa3e7-df19-4281-a16e-b67a04a9aef7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:19.798865 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a21fa3e7-df19-4281-a16e-b67a04a9aef7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:19.799989 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a21fa3e7-df19-4281-a16e-b67a04a9aef7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:19.808004 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a21fa3e7-df19-4281-a16e-b67a04a9aef7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:19.809206 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a21fa3e7-df19-4281-a16e-b67a04a9aef7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:19.916523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a21fa3e7-df19-4281-a16e-b67a04a9aef7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 28180 microversion: 2.20 time: 0.496684 Dec 18 03:17:19.917547 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 360/704] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:19 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 28180 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:20.929140 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8f634fde-3d94-4d26-a93b-0a14109525da tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:20.930102 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8f634fde-3d94-4d26-a93b-0a14109525da tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:20.938203 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f634fde-3d94-4d26-a93b-0a14109525da tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:20.939144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f634fde-3d94-4d26-a93b-0a14109525da tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:20.940291 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f634fde-3d94-4d26-a93b-0a14109525da tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:20.940907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8f634fde-3d94-4d26-a93b-0a14109525da tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:21.042809 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8f634fde-3d94-4d26-a93b-0a14109525da tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 28180 microversion: 2.20 time: 0.117713 Dec 18 03:17:21.047615 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 345/705] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:20 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 28180 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:22.056006 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-89ad62c9-767a-4a11-826e-54e55836ad5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:22.057368 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-89ad62c9-767a-4a11-826e-54e55836ad5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:22.065794 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89ad62c9-767a-4a11-826e-54e55836ad5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:22.066235 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89ad62c9-767a-4a11-826e-54e55836ad5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:22.067198 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89ad62c9-767a-4a11-826e-54e55836ad5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:22.067809 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89ad62c9-767a-4a11-826e-54e55836ad5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:22.177203 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-89ad62c9-767a-4a11-826e-54e55836ad5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 28471 microversion: 2.20 time: 0.124714 Dec 18 03:17:22.178241 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 361/706] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:22 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 28471 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:23.189367 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-51a7b36b-13a0-4396-8439-44c8893fb820 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:23.190550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-51a7b36b-13a0-4396-8439-44c8893fb820 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:23.198706 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-51a7b36b-13a0-4396-8439-44c8893fb820 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:23.199590 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-51a7b36b-13a0-4396-8439-44c8893fb820 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:23.200797 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-51a7b36b-13a0-4396-8439-44c8893fb820 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:23.201443 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-51a7b36b-13a0-4396-8439-44c8893fb820 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:25.523968 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-51a7b36b-13a0-4396-8439-44c8893fb820 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 28639 microversion: 2.20 time: 2.338360 Dec 18 03:17:25.525162 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 346/707] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:23 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 28639 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:17:26.537858 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-adf2610f-e6fe-4aff-b7f8-97409a248c87 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:26.538972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-adf2610f-e6fe-4aff-b7f8-97409a248c87 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:26.547601 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-adf2610f-e6fe-4aff-b7f8-97409a248c87 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:26.548330 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-adf2610f-e6fe-4aff-b7f8-97409a248c87 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:26.549118 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-adf2610f-e6fe-4aff-b7f8-97409a248c87 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:26.549575 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-adf2610f-e6fe-4aff-b7f8-97409a248c87 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:26.637742 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-adf2610f-e6fe-4aff-b7f8-97409a248c87 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 28639 microversion: 2.20 time: 0.103904 Dec 18 03:17:26.638692 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 362/708] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:26 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 28639 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:26.809773 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-855f9e50-db85-4cfd-9dc4-b4f007908af8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Action: 'create', calling method: .version_select at 0x7fad2657f3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-815539649"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:26.825162 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-855f9e50-db85-4cfd-9dc4-b4f007908af8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Getting quotas for project 535faa61f3e345e6be0cc8a3f85fb207. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:17:26.828899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-855f9e50-db85-4cfd-9dc4-b4f007908af8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Getting quotas for user eaad7c4549cb461a9584bec015c9b118 and project 535faa61f3e345e6be0cc8a3f85fb207. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:17:26.973530 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-855f9e50-db85-4cfd-9dc4-b4f007908af8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Getting quotas for project 535faa61f3e345e6be0cc8a3f85fb207. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:17:26.977087 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-855f9e50-db85-4cfd-9dc4-b4f007908af8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Getting quotas for user eaad7c4549cb461a9584bec015c9b118 and project 535faa61f3e345e6be0cc8a3f85fb207. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:17:26.991494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-855f9e50-db85-4cfd-9dc4-b4f007908af8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.186320 Dec 18 03:17:26.992099 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 347/709] 10.222.0.24 () {60 vars in 1157 bytes} [Sat Dec 18 03:17:26 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:27.040279 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2013664442", "imageRef": "46f88624-6ac1-4fe8-b2e6-7bc0b3d2b9ee", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-815539649", "networks": [{"uuid": "958d444c-83a1-4f27-9e84-9aaa6d65bd7a"}]}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:27.154276 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] validate_networks() for [('958d444c-83a1-4f27-9e84-9aaa6d65bd7a', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:17:27.622054 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:17:27.622685 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:17:27.623026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:17:27.623466 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:17:27.623907 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:17:27.633189 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:27.633652 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:27.634647 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:27.635202 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:27.649692 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4408529a-59ec-4790-b1ff-4d2340ea6f95 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:27.650797 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4408529a-59ec-4790-b1ff-4d2340ea6f95 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:27.654028 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Getting quotas for project 535faa61f3e345e6be0cc8a3f85fb207. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:17:27.657637 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4408529a-59ec-4790-b1ff-4d2340ea6f95 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:27.658076 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4408529a-59ec-4790-b1ff-4d2340ea6f95 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:27.658595 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Getting quotas for user eaad7c4549cb461a9584bec015c9b118 and project 535faa61f3e345e6be0cc8a3f85fb207. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:17:27.658848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4408529a-59ec-4790-b1ff-4d2340ea6f95 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:27.659273 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4408529a-59ec-4790-b1ff-4d2340ea6f95 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:27.673298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:17:27.675693 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46f88624-6ac1-4fe8-b2e6-7bc0b3d2b9ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:17:27.722492 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-76bca404-04de-4e9b-a782-717de2286fd3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686086 Dec 18 03:17:27.723169 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 363/710] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:17:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:17:27.733492 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9aa5c52a-97a1-4306-bff9-31c813b7ee3f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:27.734140 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9aa5c52a-97a1-4306-bff9-31c813b7ee3f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:27.743297 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4408529a-59ec-4790-b1ff-4d2340ea6f95 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 28639 microversion: 2.20 time: 0.097126 Dec 18 03:17:27.744365 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 348/711] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:27 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 28639 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:17:27.785894 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9aa5c52a-97a1-4306-bff9-31c813b7ee3f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:27.792352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9aa5c52a-97a1-4306-bff9-31c813b7ee3f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1258 microversion: 2.1 time: 0.063545 Dec 18 03:17:27.793994 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 364/712] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:27 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:17:28.755894 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c93503b2-0736-4acd-9e6c-6e3ff6937185 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:28.757946 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c93503b2-0736-4acd-9e6c-6e3ff6937185 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:28.766738 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c93503b2-0736-4acd-9e6c-6e3ff6937185 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:28.767566 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c93503b2-0736-4acd-9e6c-6e3ff6937185 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:28.768633 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c93503b2-0736-4acd-9e6c-6e3ff6937185 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:28.769312 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c93503b2-0736-4acd-9e6c-6e3ff6937185 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:28.814203 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5434f006-f661-41dd-8028-64c0bb16e7a7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:28.815036 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5434f006-f661-41dd-8028-64c0bb16e7a7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:28.822506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5434f006-f661-41dd-8028-64c0bb16e7a7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:28.827028 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5434f006-f661-41dd-8028-64c0bb16e7a7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:28.827975 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5434f006-f661-41dd-8028-64c0bb16e7a7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:28.828488 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5434f006-f661-41dd-8028-64c0bb16e7a7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:28.899804 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c93503b2-0736-4acd-9e6c-6e3ff6937185 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 28990 microversion: 2.20 time: 0.147783 Dec 18 03:17:28.900515 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 349/713] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:28 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 28990 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:17:28.942637 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5434f006-f661-41dd-8028-64c0bb16e7a7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:28.953589 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5434f006-f661-41dd-8028-64c0bb16e7a7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1318 microversion: 2.1 time: 0.147967 Dec 18 03:17:28.966104 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 365/714] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:28 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:29.916233 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bb932b9a-a5e6-4749-9266-0114bdd45508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:29.917467 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bb932b9a-a5e6-4749-9266-0114bdd45508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:29.931381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bb932b9a-a5e6-4749-9266-0114bdd45508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:29.940026 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bb932b9a-a5e6-4749-9266-0114bdd45508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:29.941199 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bb932b9a-a5e6-4749-9266-0114bdd45508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:29.942101 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bb932b9a-a5e6-4749-9266-0114bdd45508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:29.976456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-29fb97d5-29b8-4c7e-b619-f6d617ac11c0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:29.977364 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-29fb97d5-29b8-4c7e-b619-f6d617ac11c0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:29.993083 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-29fb97d5-29b8-4c7e-b619-f6d617ac11c0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:29.993523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-29fb97d5-29b8-4c7e-b619-f6d617ac11c0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:29.994543 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-29fb97d5-29b8-4c7e-b619-f6d617ac11c0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:29.994985 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-29fb97d5-29b8-4c7e-b619-f6d617ac11c0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:30.206875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-29fb97d5-29b8-4c7e-b619-f6d617ac11c0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:30.232023 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-29fb97d5-29b8-4c7e-b619-f6d617ac11c0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.264191 Dec 18 03:17:30.233191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 366/715] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:29 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:17:31.253739 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9a1d7af3-c91f-44a5-a889-7f73ec3f0c38 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:31.255109 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9a1d7af3-c91f-44a5-a889-7f73ec3f0c38 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:31.261675 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a1d7af3-c91f-44a5-a889-7f73ec3f0c38 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:31.262704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a1d7af3-c91f-44a5-a889-7f73ec3f0c38 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:31.263920 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a1d7af3-c91f-44a5-a889-7f73ec3f0c38 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:31.264600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a1d7af3-c91f-44a5-a889-7f73ec3f0c38 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:31.666661 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9a1d7af3-c91f-44a5-a889-7f73ec3f0c38 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:31.676002 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9a1d7af3-c91f-44a5-a889-7f73ec3f0c38 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.425727 Dec 18 03:17:31.677150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 367/716] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:31 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:17:32.695535 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d1d9a08b-1b2c-4b9d-b46a-b591394448aa tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:32.696274 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d1d9a08b-1b2c-4b9d-b46a-b591394448aa tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:32.703145 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d1d9a08b-1b2c-4b9d-b46a-b591394448aa tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:32.703674 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d1d9a08b-1b2c-4b9d-b46a-b591394448aa tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:32.704466 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d1d9a08b-1b2c-4b9d-b46a-b591394448aa tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:32.705033 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d1d9a08b-1b2c-4b9d-b46a-b591394448aa tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:32.865645 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d1d9a08b-1b2c-4b9d-b46a-b591394448aa tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:32.873663 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d1d9a08b-1b2c-4b9d-b46a-b591394448aa tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.183502 Dec 18 03:17:32.874227 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 368/717] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:32 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:17:33.897486 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4ee9977a-b81c-466d-832d-cda87f4b36e0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:33.899386 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4ee9977a-b81c-466d-832d-cda87f4b36e0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:33.907446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4ee9977a-b81c-466d-832d-cda87f4b36e0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:33.914721 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4ee9977a-b81c-466d-832d-cda87f4b36e0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:33.915672 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4ee9977a-b81c-466d-832d-cda87f4b36e0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:33.916344 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4ee9977a-b81c-466d-832d-cda87f4b36e0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:34.075516 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4ee9977a-b81c-466d-832d-cda87f4b36e0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:34.082951 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4ee9977a-b81c-466d-832d-cda87f4b36e0 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.189130 Dec 18 03:17:34.083532 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 369/718] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:33 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:17:35.100839 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9a0e2ce9-693d-4619-a9dc-d52cd03dad9a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:35.101516 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9a0e2ce9-693d-4619-a9dc-d52cd03dad9a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:35.109286 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a0e2ce9-693d-4619-a9dc-d52cd03dad9a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:35.109755 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a0e2ce9-693d-4619-a9dc-d52cd03dad9a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:35.110583 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a0e2ce9-693d-4619-a9dc-d52cd03dad9a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:35.110967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9a0e2ce9-693d-4619-a9dc-d52cd03dad9a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:35.252053 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9a0e2ce9-693d-4619-a9dc-d52cd03dad9a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:35.260532 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9a0e2ce9-693d-4619-a9dc-d52cd03dad9a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.163606 Dec 18 03:17:35.261710 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 370/719] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:35 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:36.278413 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6cc8af18-ce36-4678-bcea-505fd992f4ef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:36.279220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6cc8af18-ce36-4678-bcea-505fd992f4ef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:36.286292 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6cc8af18-ce36-4678-bcea-505fd992f4ef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:36.286816 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6cc8af18-ce36-4678-bcea-505fd992f4ef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:36.287782 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6cc8af18-ce36-4678-bcea-505fd992f4ef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:36.288267 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6cc8af18-ce36-4678-bcea-505fd992f4ef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:36.441466 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6cc8af18-ce36-4678-bcea-505fd992f4ef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:36.454452 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6cc8af18-ce36-4678-bcea-505fd992f4ef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.175827 Dec 18 03:17:36.455207 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 371/720] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:36 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:37.471508 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-123a2302-ca6d-489e-87a4-99de7ac559c6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:37.472235 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-123a2302-ca6d-489e-87a4-99de7ac559c6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:37.479174 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-123a2302-ca6d-489e-87a4-99de7ac559c6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:37.479765 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-123a2302-ca6d-489e-87a4-99de7ac559c6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:37.480889 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-123a2302-ca6d-489e-87a4-99de7ac559c6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:37.481388 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-123a2302-ca6d-489e-87a4-99de7ac559c6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:37.629540 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-123a2302-ca6d-489e-87a4-99de7ac559c6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:37.638155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-123a2302-ca6d-489e-87a4-99de7ac559c6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.170212 Dec 18 03:17:37.638877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 372/721] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:37 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:38.655039 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-424f1b71-6b25-489c-95a2-79eaeeb0eb0a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:38.655945 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-424f1b71-6b25-489c-95a2-79eaeeb0eb0a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:38.663387 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-424f1b71-6b25-489c-95a2-79eaeeb0eb0a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:38.664218 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-424f1b71-6b25-489c-95a2-79eaeeb0eb0a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:38.665176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-424f1b71-6b25-489c-95a2-79eaeeb0eb0a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:38.665875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-424f1b71-6b25-489c-95a2-79eaeeb0eb0a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:38.825699 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-424f1b71-6b25-489c-95a2-79eaeeb0eb0a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:38.833816 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-424f1b71-6b25-489c-95a2-79eaeeb0eb0a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.182440 Dec 18 03:17:38.834401 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 373/722] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:38 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:17:39.850928 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b0016bab-0b20-4e9f-b75e-e4846809ed65 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:39.851538 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b0016bab-0b20-4e9f-b75e-e4846809ed65 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:39.858399 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0016bab-0b20-4e9f-b75e-e4846809ed65 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:39.858846 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0016bab-0b20-4e9f-b75e-e4846809ed65 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:39.859616 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0016bab-0b20-4e9f-b75e-e4846809ed65 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:39.860048 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0016bab-0b20-4e9f-b75e-e4846809ed65 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:39.995440 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b0016bab-0b20-4e9f-b75e-e4846809ed65 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:40.002859 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b0016bab-0b20-4e9f-b75e-e4846809ed65 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.155545 Dec 18 03:17:40.003434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 374/723] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:39 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:17:40.409240 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bb932b9a-a5e6-4749-9266-0114bdd45508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 200 len: 38332 microversion: 2.20 time: 10.500022 Dec 18 03:17:40.410405 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 350/724] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:29 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 38332 bytes in 10502 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:17:40.419473 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-efdab2a0-c020-4cfc-837b-7ec37fedffce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:40.419960 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-efdab2a0-c020-4cfc-837b-7ec37fedffce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:40.425599 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-efdab2a0-c020-4cfc-837b-7ec37fedffce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:40.426074 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-efdab2a0-c020-4cfc-837b-7ec37fedffce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:40.426842 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-efdab2a0-c020-4cfc-837b-7ec37fedffce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:40.427269 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-efdab2a0-c020-4cfc-837b-7ec37fedffce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:40.453584 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-efdab2a0-c020-4cfc-837b-7ec37fedffce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/ips" status: 200 len: 152 microversion: 2.20 time: 0.037730 Dec 18 03:17:40.454188 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 375/725] 10.222.0.24 () {60 vars in 1288 bytes} [Sat Dec 18 03:17:40 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:17:41.020679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8c543343-7500-431a-a8a7-90bfb0ebb7bd tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:41.021378 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8c543343-7500-431a-a8a7-90bfb0ebb7bd tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:41.029669 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c543343-7500-431a-a8a7-90bfb0ebb7bd tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:41.030179 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c543343-7500-431a-a8a7-90bfb0ebb7bd tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:41.031074 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c543343-7500-431a-a8a7-90bfb0ebb7bd tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:41.031545 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8c543343-7500-431a-a8a7-90bfb0ebb7bd tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:41.265005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-3660d129-0d43-48bf-b553-402d038f8c1f req-0db121d2-b520-451d-95cd-63e67d20d69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83329381-8624-4e96-a968-8f2de6818b11", "tag": "86879b2c-8d5c-4c8e-b9e7-e91bea976d75"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:41.266608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:17:41.266608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:17:41.275267 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-3660d129-0d43-48bf-b553-402d038f8c1f req-0db121d2-b520-451d-95cd-63e67d20d69a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:41.275741 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-3660d129-0d43-48bf-b553-402d038f8c1f req-0db121d2-b520-451d-95cd-63e67d20d69a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:41.288209 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-3660d129-0d43-48bf-b553-402d038f8c1f req-0db121d2-b520-451d-95cd-63e67d20d69a service nova] Creating event network-changed:86879b2c-8d5c-4c8e-b9e7-e91bea976d75 for instance 83329381-8624-4e96-a968-8f2de6818b11 on hv-cinder-81803 Dec 18 03:17:41.295028 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-3660d129-0d43-48bf-b553-402d038f8c1f req-0db121d2-b520-451d-95cd-63e67d20d69a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201818 Dec 18 03:17:41.295785 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 376/726] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:17:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:17:41.445550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-8c543343-7500-431a-a8a7-90bfb0ebb7bd tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:41.453666 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8c543343-7500-431a-a8a7-90bfb0ebb7bd tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.436857 Dec 18 03:17:41.454245 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 351/727] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:41 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:42.471594 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b51d881f-9089-46e5-a241-71f76977411d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:42.472292 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b51d881f-9089-46e5-a241-71f76977411d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:42.478600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b51d881f-9089-46e5-a241-71f76977411d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:42.479044 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b51d881f-9089-46e5-a241-71f76977411d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:42.479819 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b51d881f-9089-46e5-a241-71f76977411d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:42.480514 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b51d881f-9089-46e5-a241-71f76977411d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:42.611283 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b51d881f-9089-46e5-a241-71f76977411d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:42.618706 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b51d881f-9089-46e5-a241-71f76977411d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.151513 Dec 18 03:17:42.619267 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 377/728] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:42 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:42.724530 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6b6d435c-f5a7-4510-8c06-2dc8285d2598 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:42.725083 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6b6d435c-f5a7-4510-8c06-2dc8285d2598 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:42.731784 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b6d435c-f5a7-4510-8c06-2dc8285d2598 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:42.732229 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b6d435c-f5a7-4510-8c06-2dc8285d2598 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:42.733013 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b6d435c-f5a7-4510-8c06-2dc8285d2598 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:42.733446 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6b6d435c-f5a7-4510-8c06-2dc8285d2598 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:42.756631 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-6b6d435c-f5a7-4510-8c06-2dc8285d2598 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lazy-loading 'flavor' on Instance uuid d6ea4525-cf68-4ac8-9908-4857fde99da8 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:17:43.012588 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6b6d435c-f5a7-4510-8c06-2dc8285d2598 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 202 len: 0 microversion: 2.20 time: 0.291681 Dec 18 03:17:43.013367 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 352/729] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:17:42 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:17:43.021354 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:43.022225 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:43.028135 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:43.028699 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:43.029578 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:43.029996 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:43.164725 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:43.173792 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:43.175260 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:43.176402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4da07ce3-2eec-4f74-a237-2e83f1b0c87e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.158867 Dec 18 03:17:43.176952 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 378/730] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:43 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:43.636946 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-45f324e0-e11c-4d83-8271-b7ea6ee0343e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:43.638248 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-45f324e0-e11c-4d83-8271-b7ea6ee0343e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:43.644396 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45f324e0-e11c-4d83-8271-b7ea6ee0343e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:43.644833 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45f324e0-e11c-4d83-8271-b7ea6ee0343e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:43.645600 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45f324e0-e11c-4d83-8271-b7ea6ee0343e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:43.646047 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45f324e0-e11c-4d83-8271-b7ea6ee0343e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:43.781867 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-45f324e0-e11c-4d83-8271-b7ea6ee0343e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:43.789040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-45f324e0-e11c-4d83-8271-b7ea6ee0343e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.156613 Dec 18 03:17:43.789640 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 353/731] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:43 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:44.195186 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:44.195806 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:44.202573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:44.203010 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:44.203785 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:44.204207 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:44.335585 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:44.343893 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:44.345940 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:44.347091 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a3dd7ba5-12a4-428e-ac05-7f63430f4f5a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.155559 Dec 18 03:17:44.347694 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 379/732] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:44 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:44.806847 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-941ecc1b-2487-47d9-b390-613170f3b881 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:44.807458 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-941ecc1b-2487-47d9-b390-613170f3b881 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:44.813883 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-941ecc1b-2487-47d9-b390-613170f3b881 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:44.814327 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-941ecc1b-2487-47d9-b390-613170f3b881 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:44.815091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-941ecc1b-2487-47d9-b390-613170f3b881 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:44.815517 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-941ecc1b-2487-47d9-b390-613170f3b881 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:44.945752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-941ecc1b-2487-47d9-b390-613170f3b881 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:44.954297 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-941ecc1b-2487-47d9-b390-613170f3b881 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.151446 Dec 18 03:17:44.954899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 354/733] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:44 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:45.366595 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:45.367295 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:45.374501 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:45.374945 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:45.375737 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:45.376164 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:45.507552 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:45.515602 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:45.517087 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:45.518284 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-302ff87c-750e-4c51-9fd9-7576c9c66591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.155403 Dec 18 03:17:45.518841 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 380/734] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:45 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:45.971166 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-97ff2f27-15da-472d-a702-59761dbde9dc tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:45.971775 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-97ff2f27-15da-472d-a702-59761dbde9dc tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:45.978812 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97ff2f27-15da-472d-a702-59761dbde9dc tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:45.979253 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97ff2f27-15da-472d-a702-59761dbde9dc tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:45.980298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97ff2f27-15da-472d-a702-59761dbde9dc tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:45.980726 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97ff2f27-15da-472d-a702-59761dbde9dc tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:46.112008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-97ff2f27-15da-472d-a702-59761dbde9dc tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:46.119505 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-97ff2f27-15da-472d-a702-59761dbde9dc tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.151992 Dec 18 03:17:46.120056 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 355/735] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:45 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:46.451597 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-3fbacf2b-93ed-40f6-b1d0-0a85b908a732 req-1ae923cb-6fa0-4f85-881b-06d3787d19d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83329381-8624-4e96-a968-8f2de6818b11", "name": "network-vif-plugged", "status": "completed", "tag": "86879b2c-8d5c-4c8e-b9e7-e91bea976d75"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:46.453178 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:17:46.453178 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:17:46.459896 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-3fbacf2b-93ed-40f6-b1d0-0a85b908a732 req-1ae923cb-6fa0-4f85-881b-06d3787d19d5 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:46.460344 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-3fbacf2b-93ed-40f6-b1d0-0a85b908a732 req-1ae923cb-6fa0-4f85-881b-06d3787d19d5 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:46.471589 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-3fbacf2b-93ed-40f6-b1d0-0a85b908a732 req-1ae923cb-6fa0-4f85-881b-06d3787d19d5 service nova] Creating event network-vif-plugged:86879b2c-8d5c-4c8e-b9e7-e91bea976d75 for instance 83329381-8624-4e96-a968-8f2de6818b11 on hv-cinder-81803 Dec 18 03:17:46.476177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-3fbacf2b-93ed-40f6-b1d0-0a85b908a732 req-1ae923cb-6fa0-4f85-881b-06d3787d19d5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084906 Dec 18 03:17:46.476763 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 381/736] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:17:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:17:46.536388 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:46.537041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:46.542750 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:46.543189 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:46.543964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:46.544531 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:46.710743 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:46.718986 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:46.720460 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:46.721596 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4ff6abeb-19bd-4688-8991-152626f6f52d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.189080 Dec 18 03:17:46.722167 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 356/737] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:46 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:47.136418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-18dcaa20-2484-4627-9f9d-1c1ce2a84170 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:47.137147 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-18dcaa20-2484-4627-9f9d-1c1ce2a84170 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:47.143740 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18dcaa20-2484-4627-9f9d-1c1ce2a84170 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:47.144186 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18dcaa20-2484-4627-9f9d-1c1ce2a84170 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:47.144962 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18dcaa20-2484-4627-9f9d-1c1ce2a84170 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:47.145399 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18dcaa20-2484-4627-9f9d-1c1ce2a84170 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:47.272959 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-18dcaa20-2484-4627-9f9d-1c1ce2a84170 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:47.280220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-18dcaa20-2484-4627-9f9d-1c1ce2a84170 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1358 microversion: 2.1 time: 0.147786 Dec 18 03:17:47.280776 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 382/738] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:47 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:47.740569 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:47.741114 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:47.747994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:47.748449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:47.749226 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:47.749686 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:47.880451 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:47.888145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:47.889792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:47.890955 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-47e9e380-883a-483c-a670-d5c79ed12310 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.154257 Dec 18 03:17:47.891514 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 357/739] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:47 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:48.296429 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bfb235de-347a-4de3-bd0f-23dbd4972438 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:48.297059 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bfb235de-347a-4de3-bd0f-23dbd4972438 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:48.303451 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bfb235de-347a-4de3-bd0f-23dbd4972438 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.303891 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bfb235de-347a-4de3-bd0f-23dbd4972438 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.304658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bfb235de-347a-4de3-bd0f-23dbd4972438 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.305084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bfb235de-347a-4de3-bd0f-23dbd4972438 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.432038 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bfb235de-347a-4de3-bd0f-23dbd4972438 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:48.439608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bfb235de-347a-4de3-bd0f-23dbd4972438 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1548 microversion: 2.1 time: 0.146772 Dec 18 03:17:48.440179 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 383/740] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:48 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:48.455629 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b836483a-1405-435c-bab1-876fbbf3bab6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:48.456255 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b836483a-1405-435c-bab1-876fbbf3bab6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:48.462072 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b836483a-1405-435c-bab1-876fbbf3bab6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.462510 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b836483a-1405-435c-bab1-876fbbf3bab6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.463280 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b836483a-1405-435c-bab1-876fbbf3bab6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.463705 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b836483a-1405-435c-bab1-876fbbf3bab6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.589174 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b836483a-1405-435c-bab1-876fbbf3bab6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:48.596523 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b836483a-1405-435c-bab1-876fbbf3bab6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1548 microversion: 2.1 time: 0.144485 Dec 18 03:17:48.597086 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 358/741] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:48 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:17:48.612436 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5dc1ef96-4c11-4698-aa84-444561d7712a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:48.615783 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:17:48.615783 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:17:48.616766 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5dc1ef96-4c11-4698-aa84-444561d7712a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:48.617499 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5dc1ef96-4c11-4698-aa84-444561d7712a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Searching by: {'deleted': False, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207'} {{(pid=116001) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 18 03:17:48.624578 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5dc1ef96-4c11-4698-aa84-444561d7712a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.625018 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5dc1ef96-4c11-4698-aa84-444561d7712a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.625861 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5dc1ef96-4c11-4698-aa84-444561d7712a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.626288 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5dc1ef96-4c11-4698-aa84-444561d7712a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.713289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.multi_cell_list [None req-5dc1ef96-4c11-4698-aa84-444561d7712a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 18 03:17:48.804233 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5dc1ef96-4c11-4698-aa84-444561d7712a tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.195275 Dec 18 03:17:48.804824 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 384/742] 10.222.0.24 () {58 vars in 1124 bytes} [Sat Dec 18 03:17:48 2021] GET /compute/v2.1/servers => generated 343 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:17:48.815263 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5303b2cb-adf5-42dd-93ce-01f0b8de8144 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:48.815902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5303b2cb-adf5-42dd-93ce-01f0b8de8144 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:48.822181 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5303b2cb-adf5-42dd-93ce-01f0b8de8144 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.822624 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5303b2cb-adf5-42dd-93ce-01f0b8de8144 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.823396 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5303b2cb-adf5-42dd-93ce-01f0b8de8144 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.823829 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5303b2cb-adf5-42dd-93ce-01f0b8de8144 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.908022 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:48.908636 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:48.914515 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.914970 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.915750 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:48.916187 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:48.956466 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5303b2cb-adf5-42dd-93ce-01f0b8de8144 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:48.963899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5303b2cb-adf5-42dd-93ce-01f0b8de8144 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1548 microversion: 2.1 time: 0.152153 Dec 18 03:17:48.964419 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 359/743] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:48 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:49.055408 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:49.063876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:49.065452 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:49.066727 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f9c44fab-676b-4dc4-8fa5-dbefb50e98f6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.162389 Dec 18 03:17:49.067366 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 385/744] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:48 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:17:50.085248 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:50.085860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:50.092578 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:50.093017 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:50.093826 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:50.094258 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:50.221931 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:50.229512 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:50.231333 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:50.232514 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5394daaf-d80d-481c-94e5-b2b5bb1cefaf tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.150995 Dec 18 03:17:50.233063 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 360/745] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:50 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:50.451311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-94703c09-d78b-4b41-a592-ae431dcf0539 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "daf95b27-f4aa-451f-9e4c-ea9fc416dceb"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:17:50.452446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-94703c09-d78b-4b41-a592-ae431dcf0539 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:50.458771 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-94703c09-d78b-4b41-a592-ae431dcf0539 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:50.459232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-94703c09-d78b-4b41-a592-ae431dcf0539 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:50.459992 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-94703c09-d78b-4b41-a592-ae431dcf0539 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:50.460428 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-94703c09-d78b-4b41-a592-ae431dcf0539 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:50.713222 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-94703c09-d78b-4b41-a592-ae431dcf0539 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "POST /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265516 Dec 18 03:17:50.713870 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 386/746] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:17:50 2021] POST /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:17:51.251382 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:51.252068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:51.258207 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:51.258656 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:51.259456 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:51.259888 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:51.399289 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:51.409353 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:51.410909 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:51.412067 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-19b03c6f-d105-426f-ba1f-dd64cf523aa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.165387 Dec 18 03:17:51.412627 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 361/747] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:51 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:52.431837 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:52.432532 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:52.439261 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:52.439705 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:52.440476 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:52.440907 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:52.567913 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:52.576188 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:52.577843 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:52.578985 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4722ffae-5167-49ac-abdd-f7d6bd7259d0 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.151754 Dec 18 03:17:52.579550 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 387/748] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:52 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:53.596794 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:53.597430 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:53.603784 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:53.604219 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:53.605239 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:53.605689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:53.994840 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:54.002962 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:54.004453 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:54.005607 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f42b224b-11bc-462d-962b-91cd57da4461 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.412504 Dec 18 03:17:54.006192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 362/749] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:53 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:55.023582 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:55.024185 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:55.030586 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:55.031071 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:55.031846 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:55.032285 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:55.164013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:55.172658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:55.174176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:55.175318 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-cbfc6471-3720-4f9e-9c7b-747a0f0e2efe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.155459 Dec 18 03:17:55.175882 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 388/750] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:55 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:56.193880 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:56.194494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:56.201341 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:56.201857 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:56.202637 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:56.203074 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:56.331227 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:56.339116 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:56.340622 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:56.342141 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-aaae4636-0bae-4b52-bccd-e7109e228a35 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.151933 Dec 18 03:17:56.342707 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 363/751] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:56 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:57.360910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:57.361507 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:57.367970 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:57.368421 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:57.369177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:57.369603 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:57.502317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:57.510052 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:57.511534 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:57.512677 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-44209e88-b8ca-498a-a40f-a555cc78f0e4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.156006 Dec 18 03:17:57.513484 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 389/752] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:57 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:17:58.221122 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-68cbb409-e355-42c0-b72c-c7c342b00cc3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:58.221773 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-68cbb409-e355-42c0-b72c-c7c342b00cc3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:58.228048 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-68cbb409-e355-42c0-b72c-c7c342b00cc3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:58.228498 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-68cbb409-e355-42c0-b72c-c7c342b00cc3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:58.229284 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-68cbb409-e355-42c0-b72c-c7c342b00cc3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:58.229756 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-68cbb409-e355-42c0-b72c-c7c342b00cc3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:58.363445 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-68cbb409-e355-42c0-b72c-c7c342b00cc3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:58.371226 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-68cbb409-e355-42c0-b72c-c7c342b00cc3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1594 microversion: 2.1 time: 0.153691 Dec 18 03:17:58.371792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 364/753] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:17:58 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:17:58.531165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:58.531789 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:58.537958 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:58.538397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:58.539165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:58.539594 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:58.727050 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:58.735043 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:58.736515 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:58.737684 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d4cb1e9c-2310-4067-b720-9ca05562a11d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.210299 Dec 18 03:17:58.738244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 390/754] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:58 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:17:59.756282 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:17:59.756896 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:17:59.763768 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:59.764213 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:59.765002 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:17:59.765430 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:17:59.894290 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:59.902034 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:59.903545 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:17:59.904686 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5b927da5-f2d5-4c9a-b053-baf4d0682591 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.152247 Dec 18 03:17:59.905238 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 365/755] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:17:59 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:00.259870 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-f6225d6a-e906-4354-bc1d-829a364ba2fa req-b1e04d0f-0242-44e8-b074-9a6fac39869d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83329381-8624-4e96-a968-8f2de6818b11", "tag": "86879b2c-8d5c-4c8e-b9e7-e91bea976d75"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:00.262405 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:18:00.262405 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:18:00.271161 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-f6225d6a-e906-4354-bc1d-829a364ba2fa req-b1e04d0f-0242-44e8-b074-9a6fac39869d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:00.272045 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-f6225d6a-e906-4354-bc1d-829a364ba2fa req-b1e04d0f-0242-44e8-b074-9a6fac39869d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:00.287539 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-f6225d6a-e906-4354-bc1d-829a364ba2fa req-b1e04d0f-0242-44e8-b074-9a6fac39869d service nova] Creating event network-changed:86879b2c-8d5c-4c8e-b9e7-e91bea976d75 for instance 83329381-8624-4e96-a968-8f2de6818b11 on hv-cinder-81803 Dec 18 03:18:00.292871 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-f6225d6a-e906-4354-bc1d-829a364ba2fa req-b1e04d0f-0242-44e8-b074-9a6fac39869d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097976 Dec 18 03:18:00.293806 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 391/756] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:18:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:18:00.923186 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:00.923798 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:00.930287 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:00.930976 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:00.931768 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:00.932206 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:01.103281 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:01.113078 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:01.114989 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:01.116362 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-fc5317e9-d210-4ee0-bf50-6832e0c49c58 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.197439 Dec 18 03:18:01.117013 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 366/757] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:00 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:01.190557 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1ae4acf1-d20f-4c50-a667-a4f4e77f8654 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-399143997"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:01.191177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1ae4acf1-d20f-4c50-a667-a4f4e77f8654 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:01.197645 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1ae4acf1-d20f-4c50-a667-a4f4e77f8654 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:01.198107 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1ae4acf1-d20f-4c50-a667-a4f4e77f8654 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:01.198888 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1ae4acf1-d20f-4c50-a667-a4f4e77f8654 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:01.199315 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1ae4acf1-d20f-4c50-a667-a4f4e77f8654 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:01.338709 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.network.security_group_api [None req-1ae4acf1-d20f-4c50-a667-a4f4e77f8654 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Adding security group e19d6e20-2ce3-4920-96c8-19b85354b322 to port 86879b2c-8d5c-4c8e-b9e7-e91bea976d75 Dec 18 03:18:01.702628 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1ae4acf1-d20f-4c50-a667-a4f4e77f8654 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "POST /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/action" status: 202 len: 0 microversion: 2.1 time: 0.516096 Dec 18 03:18:01.708054 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 392/758] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:18:01 2021] POST /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:18:01.711586 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-836a51b5-80ae-47b9-b184-9edd89ac3d09 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:01.712206 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-836a51b5-80ae-47b9-b184-9edd89ac3d09 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:01.719621 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-836a51b5-80ae-47b9-b184-9edd89ac3d09 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:01.720927 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-836a51b5-80ae-47b9-b184-9edd89ac3d09 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:01.724465 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-836a51b5-80ae-47b9-b184-9edd89ac3d09 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:01.725235 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-836a51b5-80ae-47b9-b184-9edd89ac3d09 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:01.987698 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-836a51b5-80ae-47b9-b184-9edd89ac3d09 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:01.996093 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-836a51b5-80ae-47b9-b184-9edd89ac3d09 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1640 microversion: 2.1 time: 0.288118 Dec 18 03:18:01.996668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 367/759] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:01 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1640 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:02.144772 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:02.145430 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:02.151765 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:02.152219 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:02.153095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:02.153507 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:02.302914 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:02.310815 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-f691b2ce-390b-4ba1-b577-9d1f6e20d0b2 req-e96ff08a-2e5c-4ee7-9622-c3f0305736b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83329381-8624-4e96-a968-8f2de6818b11", "tag": "86879b2c-8d5c-4c8e-b9e7-e91bea976d75"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:02.311989 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:02.312635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:18:02.312635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:18:02.313478 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:02.314749 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-75aab989-4b81-4576-9355-d964b8ac8a21 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1746 microversion: 2.20 time: 0.173785 Dec 18 03:18:02.315294 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 393/760] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:02 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:02.319894 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-f691b2ce-390b-4ba1-b577-9d1f6e20d0b2 req-e96ff08a-2e5c-4ee7-9622-c3f0305736b7 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:02.320437 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-f691b2ce-390b-4ba1-b577-9d1f6e20d0b2 req-e96ff08a-2e5c-4ee7-9622-c3f0305736b7 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:02.331972 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-f691b2ce-390b-4ba1-b577-9d1f6e20d0b2 req-e96ff08a-2e5c-4ee7-9622-c3f0305736b7 service nova] Creating event network-changed:86879b2c-8d5c-4c8e-b9e7-e91bea976d75 for instance 83329381-8624-4e96-a968-8f2de6818b11 on hv-cinder-81803 Dec 18 03:18:02.336977 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-f691b2ce-390b-4ba1-b577-9d1f6e20d0b2 req-e96ff08a-2e5c-4ee7-9622-c3f0305736b7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030276 Dec 18 03:18:02.337657 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 368/761] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:18:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:18:03.333826 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:03.334434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:03.340755 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:03.341283 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:03.342117 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:03.342548 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:03.471810 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:03.479425 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:03.481224 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:03.482951 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-61b5502f-a743-496a-a2fb-63cd78083fbe tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1746 microversion: 2.20 time: 0.152893 Dec 18 03:18:03.483503 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 394/762] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:03 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:04.501556 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:04.502299 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:04.509399 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:04.509876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:04.511187 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:04.511320 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:04.662653 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:04.672913 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:04.674788 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:04.676157 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0eeb855e-6128-4654-b038-34d627817a68 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.179587 Dec 18 03:18:04.689720 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 369/763] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:04 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:05.699008 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:05.699613 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:05.706591 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:05.707283 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:05.708261 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:05.708742 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:05.847668 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:05.856456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:05.858295 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:05.859859 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-baf610b6-244d-48ba-a2ad-2175ac3fc4e5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.164645 Dec 18 03:18:05.860513 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 395/764] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:05 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:06.029544 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-57f29b82-4117-4d15-8f9f-c7afd02b51b1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:06.030736 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-57f29b82-4117-4d15-8f9f-c7afd02b51b1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:06.037360 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-57f29b82-4117-4d15-8f9f-c7afd02b51b1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:06.037838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-57f29b82-4117-4d15-8f9f-c7afd02b51b1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:06.038637 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-57f29b82-4117-4d15-8f9f-c7afd02b51b1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:06.039248 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-57f29b82-4117-4d15-8f9f-c7afd02b51b1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:06.065199 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-57f29b82-4117-4d15-8f9f-c7afd02b51b1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Going to try to terminate instance {{(pid=116000) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:18:06.178851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-57f29b82-4117-4d15-8f9f-c7afd02b51b1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 204 len: 0 microversion: 2.1 time: 0.152573 Dec 18 03:18:06.180112 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 370/765] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:18:06 2021] DELETE /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:18:06.199733 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-89de4b77-7af2-4e78-aa21-71acd3fddde9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:06.200661 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-89de4b77-7af2-4e78-aa21-71acd3fddde9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:06.208746 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89de4b77-7af2-4e78-aa21-71acd3fddde9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:06.209196 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89de4b77-7af2-4e78-aa21-71acd3fddde9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:06.210059 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89de4b77-7af2-4e78-aa21-71acd3fddde9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:06.233117 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89de4b77-7af2-4e78-aa21-71acd3fddde9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:06.416893 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-89de4b77-7af2-4e78-aa21-71acd3fddde9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:06.432451 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-89de4b77-7af2-4e78-aa21-71acd3fddde9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1577 microversion: 2.1 time: 0.248079 Dec 18 03:18:06.438010 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 396/766] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:06 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:06.579645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-c35fbbb6-81a9-4949-8926-49ac6ec68468 req-68195e81-c289-4b74-98ed-7a9a261e2853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ea4525-cf68-4ac8-9908-4857fde99da8", "name": "network-vif-plugged", "status": "completed", "tag": "9d73aaca-823a-46a8-a166-0001e8e95857"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:06.581286 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:18:06.581286 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:18:06.591086 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-c35fbbb6-81a9-4949-8926-49ac6ec68468 req-68195e81-c289-4b74-98ed-7a9a261e2853 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:06.591762 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-c35fbbb6-81a9-4949-8926-49ac6ec68468 req-68195e81-c289-4b74-98ed-7a9a261e2853 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:06.603311 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-c35fbbb6-81a9-4949-8926-49ac6ec68468 req-68195e81-c289-4b74-98ed-7a9a261e2853 service nova] Creating event network-vif-plugged:9d73aaca-823a-46a8-a166-0001e8e95857 for instance d6ea4525-cf68-4ac8-9908-4857fde99da8 on hv-cinder-81803 Dec 18 03:18:06.609284 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-c35fbbb6-81a9-4949-8926-49ac6ec68468 req-68195e81-c289-4b74-98ed-7a9a261e2853 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033882 Dec 18 03:18:06.610503 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 371/767] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:18:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:18:06.880211 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:06.880881 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:06.888693 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:06.889437 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:06.890258 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:06.890718 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:07.037439 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:07.046280 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:07.048948 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:07.052393 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-21125a36-cf56-46c8-81e8-ff12b7410b30 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.175989 Dec 18 03:18:07.053055 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 397/768] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:06 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:07.452660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a97b95ba-9539-4bd7-9cb7-2aad421c264b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:07.454597 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a97b95ba-9539-4bd7-9cb7-2aad421c264b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:07.462717 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a97b95ba-9539-4bd7-9cb7-2aad421c264b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:07.463530 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a97b95ba-9539-4bd7-9cb7-2aad421c264b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:07.464646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a97b95ba-9539-4bd7-9cb7-2aad421c264b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:07.465361 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a97b95ba-9539-4bd7-9cb7-2aad421c264b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:07.646478 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a97b95ba-9539-4bd7-9cb7-2aad421c264b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:07.657196 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a97b95ba-9539-4bd7-9cb7-2aad421c264b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1577 microversion: 2.1 time: 0.207081 Dec 18 03:18:07.657997 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 372/769] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:07 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:08.071120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:08.072089 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:08.084478 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:08.088518 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:08.089435 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:08.090216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:08.297863 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:08.306001 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:08.308007 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:08.310678 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ef1da58d-bad0-4702-9314-024326e4241b tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.243155 Dec 18 03:18:08.311483 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 398/770] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:08 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:08.674557 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c2729ca3-8097-44a2-8f75-4b70f0894fd5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:08.675774 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c2729ca3-8097-44a2-8f75-4b70f0894fd5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:08.684412 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c2729ca3-8097-44a2-8f75-4b70f0894fd5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:08.685339 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c2729ca3-8097-44a2-8f75-4b70f0894fd5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:08.687958 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c2729ca3-8097-44a2-8f75-4b70f0894fd5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:08.688505 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c2729ca3-8097-44a2-8f75-4b70f0894fd5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:08.803271 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c2729ca3-8097-44a2-8f75-4b70f0894fd5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:08.815523 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c2729ca3-8097-44a2-8f75-4b70f0894fd5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1510 microversion: 2.1 time: 0.144482 Dec 18 03:18:08.829879 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 373/771] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:08 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:09.119009 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-427448c2-08e3-4613-91c5-e351e5090c7f req-1c01529a-745d-4040-be09-e124a7753899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9e593b-0924-4c44-b1f2-e978a0a72025", "name": "network-vif-deleted", "tag": "3c025ffb-e617-491c-82db-5bbcb6fa0c38"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:09.121180 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:18:09.121180 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:18:09.147123 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-427448c2-08e3-4613-91c5-e351e5090c7f req-1c01529a-745d-4040-be09-e124a7753899 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:09.147574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-427448c2-08e3-4613-91c5-e351e5090c7f req-1c01529a-745d-4040-be09-e124a7753899 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:09.178547 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-427448c2-08e3-4613-91c5-e351e5090c7f req-1c01529a-745d-4040-be09-e124a7753899 service nova] Creating event network-vif-deleted:3c025ffb-e617-491c-82db-5bbcb6fa0c38 for instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 on hv-cinder-81803 Dec 18 03:18:09.189614 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-427448c2-08e3-4613-91c5-e351e5090c7f req-1c01529a-745d-4040-be09-e124a7753899 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075921 Dec 18 03:18:09.196873 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 399/772] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:18:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:18:09.328648 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:09.329282 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:09.340198 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:09.340962 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:09.341942 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:09.342527 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:09.595838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:09.609099 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:09.610709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:09.612441 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-64b55f78-48c0-4b83-a869-6d5e4005dd51 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.288126 Dec 18 03:18:09.613331 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 374/773] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:09 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:09.844904 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:09.845655 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:09.854778 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:09.855446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:09.856325 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:09.857103 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:09.903576 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:09.904795 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:09.905716 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lazy-loading 'fault' on Instance uuid 9f9e593b-0924-4c44-b1f2-e978a0a72025 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:18:09.955447 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:09.964973 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f468ece3-a0b2-420e-9f7b-36dd60ea7659 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 200 len: 1229 microversion: 2.1 time: 0.125185 Dec 18 03:18:09.966059 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 400/774] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:09 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 1229 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:10.631399 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:10.633523 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:10.641752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:10.642895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:10.643910 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:10.644347 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:10.830343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:10.839301 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:10.840825 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:10.854600 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e2d257ce-e6c3-444d-b215-cfa7a265d291 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.227565 Dec 18 03:18:10.855445 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 375/775] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:10 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:10.984539 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-74a259d3-457e-4423-b1ed-51dea8b5879e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:10.985919 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-74a259d3-457e-4423-b1ed-51dea8b5879e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:10.993480 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-74a259d3-457e-4423-b1ed-51dea8b5879e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:10.994061 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-74a259d3-457e-4423-b1ed-51dea8b5879e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:10.995008 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-74a259d3-457e-4423-b1ed-51dea8b5879e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:10.995981 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-74a259d3-457e-4423-b1ed-51dea8b5879e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:11.017802 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-74a259d3-457e-4423-b1ed-51dea8b5879e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] HTTP exception thrown: Instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 could not be found. Dec 18 03:18:11.018927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-74a259d3-457e-4423-b1ed-51dea8b5879e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Returning 404 to user: Instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:18:11.020242 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-74a259d3-457e-4423-b1ed-51dea8b5879e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 404 len: 111 microversion: 2.1 time: 0.040081 Dec 18 03:18:11.032273 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 401/776] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:10 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:18:11.145660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-896645487", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-412012440", "security_groups": [{"name": "tempest-secgroup-smoke-228218707"}], "block_device_mapping_v2": [{"uuid": "31505c61-9a79-400d-b2fe-0e7698aa5a6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "564be5c6-0032-4b6f-a63b-8fc0ef0d3621"}]}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:11.273336 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] validate_networks() for [('564be5c6-0032-4b6f-a63b-8fc0ef0d3621', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:18:11.787197 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:18:11.787839 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:18:11.787987 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:18:11.788391 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:18:11.788793 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:18:11.799732 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:11.800178 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:11.800979 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:11.801410 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:11.819269 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for project f7f34416462043419f27fc97d17ab2bb. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:18:11.823522 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for user fd2d51b351b44cdfb136d754ffdf3f0f and project f7f34416462043419f27fc97d17ab2bb. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:18:11.874272 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:11.874873 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:11.882101 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:11.883702 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:11.884884 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:11.885548 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:11.896810 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:18:11.898965 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31505c61-9a79-400d-b2fe-0e7698aa5a6b',volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:18:12.048198 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1ad81061-3bcc-4fff-bfcb-87ede23d9dc8 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.906984 Dec 18 03:18:12.049649 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 376/777] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:18:11 2021] POST /compute/v2.1/servers => generated 405 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:18:12.061868 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-540bcbe8-8e14-4143-aba5-15e9bd1b4fe9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:12.062754 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-540bcbe8-8e14-4143-aba5-15e9bd1b4fe9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:12.082680 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:12.095687 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:12.097520 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:12.098823 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d229d7c8-df17-4ae8-8aca-b620f642308a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.228374 Dec 18 03:18:12.110763 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 402/778] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:11 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:12.145007 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-540bcbe8-8e14-4143-aba5-15e9bd1b4fe9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:12.152671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-540bcbe8-8e14-4143-aba5-15e9bd1b4fe9 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1093 microversion: 2.1 time: 0.097342 Dec 18 03:18:12.154238 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 377/779] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:12 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1093 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:18:13.120134 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:13.121437 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:13.128757 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:13.129972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:13.130972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:13.131580 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:13.172526 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-980ad0ad-9d38-4c41-b305-56bef8c607b0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:13.173988 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-980ad0ad-9d38-4c41-b305-56bef8c607b0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:13.190600 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-980ad0ad-9d38-4c41-b305-56bef8c607b0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:13.191066 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-980ad0ad-9d38-4c41-b305-56bef8c607b0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:13.192084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-980ad0ad-9d38-4c41-b305-56bef8c607b0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:13.192538 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-980ad0ad-9d38-4c41-b305-56bef8c607b0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:13.316234 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:13.324513 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:13.326978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:13.329276 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-10867fa4-940b-42ab-91f1-bdf2910fc4df tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.212930 Dec 18 03:18:13.330385 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 403/780] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:13 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:13.332966 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-980ad0ad-9d38-4c41-b305-56bef8c607b0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:13.341319 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-980ad0ad-9d38-4c41-b305-56bef8c607b0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1199 microversion: 2.1 time: 0.174680 Dec 18 03:18:13.342519 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 378/781] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:13 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1199 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:14.348250 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:14.348881 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:14.366465 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2a7aba5d-a650-4de3-a6a3-63cf87dbbd08 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:14.369129 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2a7aba5d-a650-4de3-a6a3-63cf87dbbd08 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:14.372444 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:14.373252 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:14.377107 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:14.378120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:14.389527 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2a7aba5d-a650-4de3-a6a3-63cf87dbbd08 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:14.390301 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2a7aba5d-a650-4de3-a6a3-63cf87dbbd08 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:14.392623 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2a7aba5d-a650-4de3-a6a3-63cf87dbbd08 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:14.394192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2a7aba5d-a650-4de3-a6a3-63cf87dbbd08 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:14.629191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:14.654339 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:14.656195 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:14.657594 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-040d1aba-7b44-4445-88e5-447980c6e9b7 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.313839 Dec 18 03:18:14.673097 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 404/782] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:14 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:14.854825 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2a7aba5d-a650-4de3-a6a3-63cf87dbbd08 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:14.865527 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2a7aba5d-a650-4de3-a6a3-63cf87dbbd08 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1276 microversion: 2.1 time: 0.505464 Dec 18 03:18:14.866141 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 379/783] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:14 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1276 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:18:15.310995 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-875fcca6-6906-468f-9cc3-ab1eaefaa492 req-e1432b2b-aa72-4666-b3e2-a3273e6ddc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ae8d2c-858b-465e-8d30-9641c8bed187", "tag": "66d77aea-4360-4b4d-9dff-ae5b34ea1557"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:15.312444 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:18:15.312444 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:18:15.328202 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-875fcca6-6906-468f-9cc3-ab1eaefaa492 req-e1432b2b-aa72-4666-b3e2-a3273e6ddc0b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:15.328321 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-875fcca6-6906-468f-9cc3-ab1eaefaa492 req-e1432b2b-aa72-4666-b3e2-a3273e6ddc0b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:15.339893 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-875fcca6-6906-468f-9cc3-ab1eaefaa492 req-e1432b2b-aa72-4666-b3e2-a3273e6ddc0b service nova] Creating event network-changed:66d77aea-4360-4b4d-9dff-ae5b34ea1557 for instance d5ae8d2c-858b-465e-8d30-9641c8bed187 on hv-cinder-81803 Dec 18 03:18:15.345485 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-875fcca6-6906-468f-9cc3-ab1eaefaa492 req-e1432b2b-aa72-4666-b3e2-a3273e6ddc0b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040154 Dec 18 03:18:15.346453 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 405/784] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:18:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:18:15.684205 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:15.685020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:15.691250 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:15.691683 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:15.692461 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:15.692904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:15.884429 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-31f4c9a9-af3f-4aaf-8e18-5729f990f0b5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:15.885324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-31f4c9a9-af3f-4aaf-8e18-5729f990f0b5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:15.892760 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-31f4c9a9-af3f-4aaf-8e18-5729f990f0b5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:15.893206 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-31f4c9a9-af3f-4aaf-8e18-5729f990f0b5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:15.894128 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-31f4c9a9-af3f-4aaf-8e18-5729f990f0b5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:15.894574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-31f4c9a9-af3f-4aaf-8e18-5729f990f0b5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:16.095536 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-31f4c9a9-af3f-4aaf-8e18-5729f990f0b5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:16.106317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-31f4c9a9-af3f-4aaf-8e18-5729f990f0b5 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.226312 Dec 18 03:18:16.107294 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 406/785] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:15 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:18:16.173079 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:16.180897 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:16.182473 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:16.183722 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b463f92f-adba-43d8-b556-fc47980c0b9e tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1741 microversion: 2.20 time: 0.503755 Dec 18 03:18:16.197881 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 380/786] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:15 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1741 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:17.123484 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4c7f26c6-1e2f-4fc5-b567-0b02653c0543 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:17.124108 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4c7f26c6-1e2f-4fc5-b567-0b02653c0543 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:17.130414 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4c7f26c6-1e2f-4fc5-b567-0b02653c0543 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:17.130854 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4c7f26c6-1e2f-4fc5-b567-0b02653c0543 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:17.131614 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4c7f26c6-1e2f-4fc5-b567-0b02653c0543 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:17.132040 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4c7f26c6-1e2f-4fc5-b567-0b02653c0543 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:17.206665 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:17.207389 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:17.213701 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:17.214152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:17.214938 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:17.215915 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:17.264766 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4c7f26c6-1e2f-4fc5-b567-0b02653c0543 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:17.272060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4c7f26c6-1e2f-4fc5-b567-0b02653c0543 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.152317 Dec 18 03:18:17.272625 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 407/787] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:17 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:17.343658 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:17.351398 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:17.352891 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:17.354064 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-677acdbb-e7f0-4d1f-ad26-4a47e844531d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1723 microversion: 2.20 time: 0.151076 Dec 18 03:18:17.354621 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 381/788] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:17 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:18.289149 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ad4124e0-6532-46cb-b633-b5deef16635b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:18.289799 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ad4124e0-6532-46cb-b633-b5deef16635b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:18.296895 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad4124e0-6532-46cb-b633-b5deef16635b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:18.297340 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad4124e0-6532-46cb-b633-b5deef16635b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:18.298136 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad4124e0-6532-46cb-b633-b5deef16635b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:18.298562 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad4124e0-6532-46cb-b633-b5deef16635b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:18.373992 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:18.374596 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:18.380793 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:18.381230 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:18.382028 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:18.382458 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:18.431889 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ad4124e0-6532-46cb-b633-b5deef16635b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:18.440291 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ad4124e0-6532-46cb-b633-b5deef16635b tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.154697 Dec 18 03:18:18.440864 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 408/789] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:18 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:18.515676 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:18.524449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:18.525979 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:18.527130 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-052eb76c-f5b0-4352-be2b-cf673183c965 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1723 microversion: 2.20 time: 0.157654 Dec 18 03:18:18.528191 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 382/790] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:18 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:19.456935 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-24f8867c-6848-4b27-9e8f-fc6041709e63 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:19.457591 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-24f8867c-6848-4b27-9e8f-fc6041709e63 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:19.463924 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-24f8867c-6848-4b27-9e8f-fc6041709e63 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:19.464363 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-24f8867c-6848-4b27-9e8f-fc6041709e63 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:19.465156 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-24f8867c-6848-4b27-9e8f-fc6041709e63 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:19.465599 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-24f8867c-6848-4b27-9e8f-fc6041709e63 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:19.545066 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:19.545690 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:19.551593 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:19.552032 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:19.552802 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:19.553228 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:19.598746 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-24f8867c-6848-4b27-9e8f-fc6041709e63 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:19.606658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-24f8867c-6848-4b27-9e8f-fc6041709e63 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.153160 Dec 18 03:18:19.615618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 409/791] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:19 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:19.681646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:19.689954 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:19.691442 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:19.692583 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-53c2ea39-e414-4895-86b4-2db3b20724c1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1723 microversion: 2.20 time: 0.151397 Dec 18 03:18:19.693161 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 383/792] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:19 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:20.623313 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-58b1c23b-fe5e-404d-b759-966b050b6e74 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:20.623941 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-58b1c23b-fe5e-404d-b759-966b050b6e74 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:20.630179 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-58b1c23b-fe5e-404d-b759-966b050b6e74 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:20.630620 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-58b1c23b-fe5e-404d-b759-966b050b6e74 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:20.631383 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-58b1c23b-fe5e-404d-b759-966b050b6e74 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:20.631810 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-58b1c23b-fe5e-404d-b759-966b050b6e74 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:20.710803 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:20.711702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:20.731319 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:20.731767 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:20.732684 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:20.733261 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:20.773309 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-58b1c23b-fe5e-404d-b759-966b050b6e74 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:20.783228 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-58b1c23b-fe5e-404d-b759-966b050b6e74 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.164080 Dec 18 03:18:20.793178 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 410/793] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:20 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:20.801286 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-9a85a975-21b3-40da-931f-62072ae0d6e5 req-93abc420-9129-4aa4-a66e-8332cb72ec6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ea4525-cf68-4ac8-9908-4857fde99da8", "name": "network-vif-unplugged", "status": "completed", "tag": "9d73aaca-823a-46a8-a166-0001e8e95857"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:20.803798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:18:20.803798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:18:20.811352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-9a85a975-21b3-40da-931f-62072ae0d6e5 req-93abc420-9129-4aa4-a66e-8332cb72ec6a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:20.812150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-9a85a975-21b3-40da-931f-62072ae0d6e5 req-93abc420-9129-4aa4-a66e-8332cb72ec6a service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:20.824688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.compute.server_external_events [req-9a85a975-21b3-40da-931f-62072ae0d6e5 req-93abc420-9129-4aa4-a66e-8332cb72ec6a service nova] Unable to find a host for instance d6ea4525-cf68-4ac8-9908-4857fde99da8. Dropping event network-vif-unplugged {{(pid=116001) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 18 03:18:20.825885 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-9a85a975-21b3-40da-931f-62072ae0d6e5 req-93abc420-9129-4aa4-a66e-8332cb72ec6a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029632 Dec 18 03:18:20.827005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 411/794] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:18:20 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 18 03:18:20.900851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:20.909519 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:20.911277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:20.912529 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-be024bc5-c254-4761-96d9-eec5cd564e91 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1666 microversion: 2.20 time: 0.205781 Dec 18 03:18:20.913080 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 384/795] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:20 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:20.930508 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-43a1bde9-3aa4-413c-83ee-1ef4506e36b6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "258f51c9-6324-4fee-9960-eca122d73fb5"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:20.931688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-43a1bde9-3aa4-413c-83ee-1ef4506e36b6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:20.937964 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43a1bde9-3aa4-413c-83ee-1ef4506e36b6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:20.938412 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43a1bde9-3aa4-413c-83ee-1ef4506e36b6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:20.939178 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43a1bde9-3aa4-413c-83ee-1ef4506e36b6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:20.939609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43a1bde9-3aa4-413c-83ee-1ef4506e36b6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:21.228220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-43a1bde9-3aa4-413c-83ee-1ef4506e36b6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301554 Dec 18 03:18:21.228817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 412/796] 10.222.0.24 () {62 vars in 1363 bytes} [Sat Dec 18 03:18:20 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:18:21.336461 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4a6abb79-e84c-41f4-911b-e32b5f788b05 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:21.336950 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4a6abb79-e84c-41f4-911b-e32b5f788b05 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:21.343613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4a6abb79-e84c-41f4-911b-e32b5f788b05 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:21.344057 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4a6abb79-e84c-41f4-911b-e32b5f788b05 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:21.344837 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4a6abb79-e84c-41f4-911b-e32b5f788b05 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:21.345269 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4a6abb79-e84c-41f4-911b-e32b5f788b05 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:21.604375 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4a6abb79-e84c-41f4-911b-e32b5f788b05 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/os-volume_attachments/258f51c9-6324-4fee-9960-eca122d73fb5" status: 202 len: 0 microversion: 2.20 time: 0.271560 Dec 18 03:18:21.605270 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 385/797] 10.222.0.24 () {60 vars in 1456 bytes} [Sat Dec 18 03:18:21 2021] DELETE /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/os-volume_attachments/258f51c9-6324-4fee-9960-eca122d73fb5 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:18:21.659392 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4e4400e3-ef62-4b7c-8172-5d5073624328 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:21.659917 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4e4400e3-ef62-4b7c-8172-5d5073624328 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:21.667045 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4e4400e3-ef62-4b7c-8172-5d5073624328 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:21.667580 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4e4400e3-ef62-4b7c-8172-5d5073624328 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:21.668758 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4e4400e3-ef62-4b7c-8172-5d5073624328 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:21.669314 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4e4400e3-ef62-4b7c-8172-5d5073624328 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:21.743829 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4e4400e3-ef62-4b7c-8172-5d5073624328 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action" status: 202 len: 0 microversion: 2.20 time: 0.089159 Dec 18 03:18:21.744434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 413/798] 10.222.0.24 () {62 vars in 1318 bytes} [Sat Dec 18 03:18:21 2021] POST /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:18:21.752983 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:21.753874 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:21.760343 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:21.760783 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:21.761566 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:21.762145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:21.803464 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-eca009dc-0ff7-4538-95f4-933b9ca7ca80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:21.804076 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-eca009dc-0ff7-4538-95f4-933b9ca7ca80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:21.811789 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eca009dc-0ff7-4538-95f4-933b9ca7ca80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:21.812365 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eca009dc-0ff7-4538-95f4-933b9ca7ca80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:21.813402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eca009dc-0ff7-4538-95f4-933b9ca7ca80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:21.813933 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eca009dc-0ff7-4538-95f4-933b9ca7ca80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:21.938491 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:21.946408 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:21.948149 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:21.950100 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3634101e-4420-4834-bda9-1379d6b2cfe1 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1674 microversion: 2.20 time: 0.200147 Dec 18 03:18:21.956026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-eca009dc-0ff7-4538-95f4-933b9ca7ca80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:21.961436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 386/799] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:21 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:21.963666 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-eca009dc-0ff7-4538-95f4-933b9ca7ca80 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.167863 Dec 18 03:18:21.964223 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 414/800] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:21 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:18:22.968946 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:22.969560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:22.977439 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:22.977439 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:22.979202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:22.979202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:22.982522 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e8f3e158-6ef8-4455-995d-26d731fe3dc1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:22.983248 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e8f3e158-6ef8-4455-995d-26d731fe3dc1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:22.989140 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8f3e158-6ef8-4455-995d-26d731fe3dc1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:22.989703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8f3e158-6ef8-4455-995d-26d731fe3dc1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:22.990563 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8f3e158-6ef8-4455-995d-26d731fe3dc1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:22.991070 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e8f3e158-6ef8-4455-995d-26d731fe3dc1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:23.132574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e8f3e158-6ef8-4455-995d-26d731fe3dc1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:23.140605 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e8f3e158-6ef8-4455-995d-26d731fe3dc1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.164234 Dec 18 03:18:23.141288 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 415/801] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:22 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:23.175861 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:23.185091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:23.186719 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:23.188165 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-333820c4-a104-44df-a0e5-d1199754b8c4 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.223207 Dec 18 03:18:23.188810 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 387/802] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:22 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:24.157998 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d9126104-6c1f-48b5-8520-2da3364cfaae tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:24.158629 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d9126104-6c1f-48b5-8520-2da3364cfaae tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:24.164901 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d9126104-6c1f-48b5-8520-2da3364cfaae tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:24.165343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d9126104-6c1f-48b5-8520-2da3364cfaae tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:24.166300 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d9126104-6c1f-48b5-8520-2da3364cfaae tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:24.166721 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d9126104-6c1f-48b5-8520-2da3364cfaae tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:24.207383 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:24.208899 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:24.219503 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:24.220205 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:24.221172 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:24.221794 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:24.391538 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d9126104-6c1f-48b5-8520-2da3364cfaae tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:24.405020 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d9126104-6c1f-48b5-8520-2da3364cfaae tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.250511 Dec 18 03:18:24.406037 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 416/803] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:24 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:24.432793 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:24.441604 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:24.444268 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:24.445633 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f233b002-a70e-42e8-ad5b-ff9d3c20ee12 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.242201 Dec 18 03:18:24.446818 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 388/804] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:24 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:25.423486 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-dd89b371-db92-4aeb-88ba-b1a72843fcfa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:25.424150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-dd89b371-db92-4aeb-88ba-b1a72843fcfa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:25.430768 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dd89b371-db92-4aeb-88ba-b1a72843fcfa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:25.431226 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dd89b371-db92-4aeb-88ba-b1a72843fcfa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:25.432052 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dd89b371-db92-4aeb-88ba-b1a72843fcfa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:25.432485 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dd89b371-db92-4aeb-88ba-b1a72843fcfa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:25.465416 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:25.466134 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:25.472646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:25.473483 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:25.474711 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:25.475398 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:25.622593 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-dd89b371-db92-4aeb-88ba-b1a72843fcfa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:25.632307 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-dd89b371-db92-4aeb-88ba-b1a72843fcfa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.212393 Dec 18 03:18:25.633512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 417/805] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:25 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:25.652406 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:25.672332 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:25.673970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:25.675396 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-40222853-f528-4817-be16-0f440d844449 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.215299 Dec 18 03:18:25.675958 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 389/806] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:25 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:26.648757 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7a6f1100-12dd-415c-9ecd-1412bf8ce3aa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:26.649361 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7a6f1100-12dd-415c-9ecd-1412bf8ce3aa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:26.655643 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7a6f1100-12dd-415c-9ecd-1412bf8ce3aa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:26.656086 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7a6f1100-12dd-415c-9ecd-1412bf8ce3aa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:26.656853 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7a6f1100-12dd-415c-9ecd-1412bf8ce3aa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:26.657281 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7a6f1100-12dd-415c-9ecd-1412bf8ce3aa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:26.695537 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:26.696804 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:26.707262 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:26.708105 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:26.709128 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:26.709804 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:26.834545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7a6f1100-12dd-415c-9ecd-1412bf8ce3aa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:26.846082 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7a6f1100-12dd-415c-9ecd-1412bf8ce3aa tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.200777 Dec 18 03:18:26.847131 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 418/807] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:26 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:26.868020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:26.876610 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:26.878227 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:26.879671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1c401e78-3eba-4adc-a07a-6a4f38c06365 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.187935 Dec 18 03:18:26.880227 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 390/808] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:26 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:26.931039 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-a97d4ae2-ebac-4bbd-91cf-87671e776805 req-b95236e7-6a49-4911-9471-4219cc1e6962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ae8d2c-858b-465e-8d30-9641c8bed187", "name": "network-vif-plugged", "status": "completed", "tag": "66d77aea-4360-4b4d-9dff-ae5b34ea1557"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:26.932583 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:18:26.932583 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:18:26.939898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-a97d4ae2-ebac-4bbd-91cf-87671e776805 req-b95236e7-6a49-4911-9471-4219cc1e6962 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:26.940324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-a97d4ae2-ebac-4bbd-91cf-87671e776805 req-b95236e7-6a49-4911-9471-4219cc1e6962 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:26.957199 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-a97d4ae2-ebac-4bbd-91cf-87671e776805 req-b95236e7-6a49-4911-9471-4219cc1e6962 service nova] Creating event network-vif-plugged:66d77aea-4360-4b4d-9dff-ae5b34ea1557 for instance d5ae8d2c-858b-465e-8d30-9641c8bed187 on hv-cinder-81803 Dec 18 03:18:26.962124 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-a97d4ae2-ebac-4bbd-91cf-87671e776805 req-b95236e7-6a49-4911-9471-4219cc1e6962 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034799 Dec 18 03:18:26.962712 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 419/809] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:18:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:18:27.871079 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ac9de0b4-26ce-42cd-8517-030a9dee2599 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:27.872652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ac9de0b4-26ce-42cd-8517-030a9dee2599 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:27.895525 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac9de0b4-26ce-42cd-8517-030a9dee2599 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:27.896309 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac9de0b4-26ce-42cd-8517-030a9dee2599 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:27.897405 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac9de0b4-26ce-42cd-8517-030a9dee2599 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:27.898088 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ac9de0b4-26ce-42cd-8517-030a9dee2599 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:27.899147 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:27.900536 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:27.910055 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:27.910906 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:27.912125 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:27.912781 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:28.052381 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ac9de0b4-26ce-42cd-8517-030a9dee2599 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:28.059980 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ac9de0b4-26ce-42cd-8517-030a9dee2599 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.198916 Dec 18 03:18:28.060948 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 391/810] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:27 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:28.084703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:28.094306 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:28.095804 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:28.096959 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d86ee247-9119-4187-aaf6-692c3e3234ce tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.202658 Dec 18 03:18:28.097520 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 420/811] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:27 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:29.080130 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-13e6e393-507e-4718-90a0-27a6b9519b5d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:29.080754 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-13e6e393-507e-4718-90a0-27a6b9519b5d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:29.087413 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-13e6e393-507e-4718-90a0-27a6b9519b5d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:29.087861 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-13e6e393-507e-4718-90a0-27a6b9519b5d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:29.088658 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-13e6e393-507e-4718-90a0-27a6b9519b5d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:29.089094 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-13e6e393-507e-4718-90a0-27a6b9519b5d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:29.116211 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:29.117512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:29.123899 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:29.124343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:29.125129 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:29.125731 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:29.232816 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-13e6e393-507e-4718-90a0-27a6b9519b5d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:29.240824 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-13e6e393-507e-4718-90a0-27a6b9519b5d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.164386 Dec 18 03:18:29.241597 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 392/812] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:29 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:29.282596 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:29.290215 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:29.291719 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:29.292858 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-28310082-8842-4dcf-a6c7-8c491e3d47d5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.180777 Dec 18 03:18:29.294058 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 421/813] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:29 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:30.257479 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-df3aabb7-d2b3-43d8-880e-8308db596b51 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:30.259363 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-df3aabb7-d2b3-43d8-880e-8308db596b51 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:30.271463 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df3aabb7-d2b3-43d8-880e-8308db596b51 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:30.272397 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df3aabb7-d2b3-43d8-880e-8308db596b51 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:30.273485 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df3aabb7-d2b3-43d8-880e-8308db596b51 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:30.274165 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df3aabb7-d2b3-43d8-880e-8308db596b51 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:30.311824 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:30.312425 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:30.319359 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:30.320161 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:30.321194 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:30.321873 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:30.432357 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-df3aabb7-d2b3-43d8-880e-8308db596b51 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:30.441044 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-df3aabb7-d2b3-43d8-880e-8308db596b51 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.187385 Dec 18 03:18:30.450643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 393/814] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:30 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:30.467906 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:30.475918 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:30.477408 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:30.478590 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3075ef72-7675-4695-a26d-008defce2ab6 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.170538 Dec 18 03:18:30.479257 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 422/815] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:30 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:31.458044 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f53b6280-d45e-4084-aa72-69377515291d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:31.458674 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f53b6280-d45e-4084-aa72-69377515291d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:31.465999 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f53b6280-d45e-4084-aa72-69377515291d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:31.466447 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f53b6280-d45e-4084-aa72-69377515291d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:31.467245 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f53b6280-d45e-4084-aa72-69377515291d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:31.467688 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f53b6280-d45e-4084-aa72-69377515291d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:31.498137 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:31.499689 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:31.507790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:31.508514 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:31.509573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:31.510126 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:31.658004 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f53b6280-d45e-4084-aa72-69377515291d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:31.664232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:31.666070 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f53b6280-d45e-4084-aa72-69377515291d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.211477 Dec 18 03:18:31.666641 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 394/816] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:31 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:31.672907 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:31.674725 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:31.676104 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c0cd5bfe-1b7d-49a6-b2e6-0d786401fd34 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.181967 Dec 18 03:18:31.676833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 423/817] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:31 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:32.682273 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-47c39631-78d8-4046-a08a-831abfc11219 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:32.682925 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-47c39631-78d8-4046-a08a-831abfc11219 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:32.689758 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-47c39631-78d8-4046-a08a-831abfc11219 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:32.690216 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-47c39631-78d8-4046-a08a-831abfc11219 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:32.691023 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-47c39631-78d8-4046-a08a-831abfc11219 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:32.691460 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-47c39631-78d8-4046-a08a-831abfc11219 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:32.696618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:32.697980 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:32.705074 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:32.705903 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:32.706698 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:32.707135 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:32.850925 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-47c39631-78d8-4046-a08a-831abfc11219 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:32.856471 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:32.867170 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:32.869709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-47c39631-78d8-4046-a08a-831abfc11219 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.191007 Dec 18 03:18:32.870369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 395/818] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:32 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:32.875297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:32.876591 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2447a3e9-38ec-40dd-8fd4-9a021333faa5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.185173 Dec 18 03:18:32.877659 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 424/819] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:32 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:33.888993 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-864306bb-d1bd-4018-a9af-aef90f29aa78 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:33.894363 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:33.894958 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:33.904399 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-864306bb-d1bd-4018-a9af-aef90f29aa78 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:33.904399 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-864306bb-d1bd-4018-a9af-aef90f29aa78 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:33.904831 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-864306bb-d1bd-4018-a9af-aef90f29aa78 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:33.905771 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-864306bb-d1bd-4018-a9af-aef90f29aa78 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:33.906196 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-864306bb-d1bd-4018-a9af-aef90f29aa78 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:33.913068 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:33.919257 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:33.920314 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:33.920758 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:34.082787 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-864306bb-d1bd-4018-a9af-aef90f29aa78 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:34.085408 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:34.092422 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-864306bb-d1bd-4018-a9af-aef90f29aa78 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.207780 Dec 18 03:18:34.102430 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 396/820] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:33 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:34.102651 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:34.102651 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:34.102651 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-51dfe115-22d5-4830-aa5e-629535b14e8a tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.207463 Dec 18 03:18:34.102970 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 425/821] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:33 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:34.187726 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2256727e-40a5-4cd0-b7a5-57ced542177f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:34.189086 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2256727e-40a5-4cd0-b7a5-57ced542177f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:34.199253 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2256727e-40a5-4cd0-b7a5-57ced542177f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:34.199704 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2256727e-40a5-4cd0-b7a5-57ced542177f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:34.200712 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2256727e-40a5-4cd0-b7a5-57ced542177f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:34.201143 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2256727e-40a5-4cd0-b7a5-57ced542177f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:34.279277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2256727e-40a5-4cd0-b7a5-57ced542177f tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "POST /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/action" status: 202 len: 0 microversion: 2.1 time: 0.095826 Dec 18 03:18:34.280467 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 397/822] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:18:34 2021] POST /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:18:34.290467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0965be98-768d-438e-82d0-538a4e9e27d7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:34.291442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0965be98-768d-438e-82d0-538a4e9e27d7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:34.298590 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0965be98-768d-438e-82d0-538a4e9e27d7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:34.299066 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0965be98-768d-438e-82d0-538a4e9e27d7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:34.299850 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0965be98-768d-438e-82d0-538a4e9e27d7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:34.300385 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0965be98-768d-438e-82d0-538a4e9e27d7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:34.453378 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0965be98-768d-438e-82d0-538a4e9e27d7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:34.462405 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0965be98-768d-438e-82d0-538a4e9e27d7 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1751 microversion: 2.1 time: 0.177289 Dec 18 03:18:34.473061 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 426/823] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:34 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:18:35.113247 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4eede094-c925-462d-8d9b-6b4cd73f9160 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:35.114860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4eede094-c925-462d-8d9b-6b4cd73f9160 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:35.121541 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:35.122166 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4eede094-c925-462d-8d9b-6b4cd73f9160 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:35.122272 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4eede094-c925-462d-8d9b-6b4cd73f9160 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:35.122405 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:35.123020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4eede094-c925-462d-8d9b-6b4cd73f9160 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:35.123453 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4eede094-c925-462d-8d9b-6b4cd73f9160 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:35.128945 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:35.129383 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:35.130186 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:35.130638 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:35.295337 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4eede094-c925-462d-8d9b-6b4cd73f9160 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:35.303742 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4eede094-c925-462d-8d9b-6b4cd73f9160 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.196090 Dec 18 03:18:35.304329 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 398/824] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:35 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:35.319723 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:35.329207 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:35.331137 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:35.332579 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-66959a37-3b89-4d22-8038-c3db70c2b787 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.215424 Dec 18 03:18:35.333370 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 427/825] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:35 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:35.480412 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-97beb103-e02e-4c52-8926-15f7d208e9cb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:35.481027 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-97beb103-e02e-4c52-8926-15f7d208e9cb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:35.486996 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97beb103-e02e-4c52-8926-15f7d208e9cb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:35.487445 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97beb103-e02e-4c52-8926-15f7d208e9cb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:35.488222 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97beb103-e02e-4c52-8926-15f7d208e9cb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:35.488648 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97beb103-e02e-4c52-8926-15f7d208e9cb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:35.739120 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-97beb103-e02e-4c52-8926-15f7d208e9cb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:35.747556 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-97beb103-e02e-4c52-8926-15f7d208e9cb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1751 microversion: 2.1 time: 0.271127 Dec 18 03:18:35.748110 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 399/826] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:35 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1751 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:36.320237 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-05cbd043-07c0-4dcb-8e6c-9ae57674183e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:36.320960 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-05cbd043-07c0-4dcb-8e6c-9ae57674183e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:36.328224 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-05cbd043-07c0-4dcb-8e6c-9ae57674183e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:36.328675 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-05cbd043-07c0-4dcb-8e6c-9ae57674183e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:36.329459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-05cbd043-07c0-4dcb-8e6c-9ae57674183e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:36.329921 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-05cbd043-07c0-4dcb-8e6c-9ae57674183e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:36.350005 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:36.350771 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:36.358175 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:36.358782 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:36.359660 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:36.360438 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:36.484265 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-05cbd043-07c0-4dcb-8e6c-9ae57674183e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:36.491779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-05cbd043-07c0-4dcb-8e6c-9ae57674183e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1264 microversion: 2.1 time: 0.175285 Dec 18 03:18:36.492414 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 428/827] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:36 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:36.530408 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:36.538494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:36.540046 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:36.541237 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-15fe9aac-2a8f-4c14-ac22-cc240191ff42 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.194888 Dec 18 03:18:36.541879 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 400/828] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:36 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:36.765210 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2e7edaa6-77b6-412a-8f5f-fbe6136f97a8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:36.765770 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2e7edaa6-77b6-412a-8f5f-fbe6136f97a8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:36.772818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e7edaa6-77b6-412a-8f5f-fbe6136f97a8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:36.773256 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e7edaa6-77b6-412a-8f5f-fbe6136f97a8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:36.774049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e7edaa6-77b6-412a-8f5f-fbe6136f97a8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:36.774478 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e7edaa6-77b6-412a-8f5f-fbe6136f97a8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:36.922973 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2e7edaa6-77b6-412a-8f5f-fbe6136f97a8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:36.932118 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2e7edaa6-77b6-412a-8f5f-fbe6136f97a8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.171152 Dec 18 03:18:36.932710 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 429/829] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:36 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:37.508185 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-35bb7b62-8f52-4415-86b0-6641fd305376 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:37.508730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-35bb7b62-8f52-4415-86b0-6641fd305376 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:37.515205 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-35bb7b62-8f52-4415-86b0-6641fd305376 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:37.515647 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-35bb7b62-8f52-4415-86b0-6641fd305376 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:37.516417 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-35bb7b62-8f52-4415-86b0-6641fd305376 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:37.516846 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-35bb7b62-8f52-4415-86b0-6641fd305376 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:37.560003 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:37.560585 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:37.566794 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:37.567240 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:37.568012 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:37.568448 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:37.656094 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-35bb7b62-8f52-4415-86b0-6641fd305376 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:37.664261 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-35bb7b62-8f52-4415-86b0-6641fd305376 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1451 microversion: 2.1 time: 0.159739 Dec 18 03:18:37.664977 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 401/830] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:37 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:18:37.679959 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a2d07c11-4b5d-40b1-baee-61af56ae9fd4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:37.680562 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a2d07c11-4b5d-40b1-baee-61af56ae9fd4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:37.687190 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a2d07c11-4b5d-40b1-baee-61af56ae9fd4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:37.687190 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a2d07c11-4b5d-40b1-baee-61af56ae9fd4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:37.688190 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a2d07c11-4b5d-40b1-baee-61af56ae9fd4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:37.688621 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a2d07c11-4b5d-40b1-baee-61af56ae9fd4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:37.702215 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:37.710325 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:37.711936 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:37.713079 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-827eb6c0-eb60-4abb-bef2-3a4776f976a9 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.156887 Dec 18 03:18:37.713651 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 430/831] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:37 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:18:37.818505 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a2d07c11-4b5d-40b1-baee-61af56ae9fd4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:37.826264 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a2d07c11-4b5d-40b1-baee-61af56ae9fd4 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1451 microversion: 2.1 time: 0.150002 Dec 18 03:18:37.826822 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 402/832] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:37 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:18:37.951579 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6d2466c1-bf20-49b7-919d-6617e8ec1155 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:37.952222 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6d2466c1-bf20-49b7-919d-6617e8ec1155 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:37.958409 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6d2466c1-bf20-49b7-919d-6617e8ec1155 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:37.958828 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6d2466c1-bf20-49b7-919d-6617e8ec1155 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:37.959608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6d2466c1-bf20-49b7-919d-6617e8ec1155 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:37.960046 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6d2466c1-bf20-49b7-919d-6617e8ec1155 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:38.105884 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6d2466c1-bf20-49b7-919d-6617e8ec1155 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:38.113728 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6d2466c1-bf20-49b7-919d-6617e8ec1155 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.166631 Dec 18 03:18:38.114294 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 431/833] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:37 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:38.731849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:38.732479 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:38.738754 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:38.739186 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:38.739959 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:38.740389 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:38.943592 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:38.952617 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:38.954298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:38.955635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-67992982-10f8-4fa2-8787-c8daca892464 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.228321 Dec 18 03:18:38.956290 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 403/834] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:38 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:39.131939 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a79e2052-6379-45f1-b435-a8d14f12965b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:39.132522 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a79e2052-6379-45f1-b435-a8d14f12965b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:39.139560 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a79e2052-6379-45f1-b435-a8d14f12965b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:39.140031 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a79e2052-6379-45f1-b435-a8d14f12965b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:39.140802 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a79e2052-6379-45f1-b435-a8d14f12965b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:39.141226 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a79e2052-6379-45f1-b435-a8d14f12965b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:39.284943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a79e2052-6379-45f1-b435-a8d14f12965b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:39.293182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a79e2052-6379-45f1-b435-a8d14f12965b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.164366 Dec 18 03:18:39.293760 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 432/835] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:39 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:39.486722 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-ee10fbc3-27cd-4cd8-b180-b8ed2d4fe139 req-c6299308-a023-456e-a261-5d578e94d92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ae8d2c-858b-465e-8d30-9641c8bed187", "tag": "66d77aea-4360-4b4d-9dff-ae5b34ea1557"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:39.488292 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:18:39.488292 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:18:39.495396 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-ee10fbc3-27cd-4cd8-b180-b8ed2d4fe139 req-c6299308-a023-456e-a261-5d578e94d92e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:39.496370 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-ee10fbc3-27cd-4cd8-b180-b8ed2d4fe139 req-c6299308-a023-456e-a261-5d578e94d92e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:39.507445 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-ee10fbc3-27cd-4cd8-b180-b8ed2d4fe139 req-c6299308-a023-456e-a261-5d578e94d92e service nova] Creating event network-changed:66d77aea-4360-4b4d-9dff-ae5b34ea1557 for instance d5ae8d2c-858b-465e-8d30-9641c8bed187 on hv-cinder-81803 Dec 18 03:18:39.512972 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-ee10fbc3-27cd-4cd8-b180-b8ed2d4fe139 req-c6299308-a023-456e-a261-5d578e94d92e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029848 Dec 18 03:18:39.513704 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 404/836] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:18:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:18:39.974508 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:39.975116 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:39.982449 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:39.982898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:39.983681 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:39.984116 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:40.119564 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:40.129318 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:40.131153 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:40.132422 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8cccc2da-8cd2-4eab-93ac-3c09cf66d324 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.161589 Dec 18 03:18:40.133391 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 433/837] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:39 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:40.310456 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1320ec5f-c0d1-440f-9624-979e7dca19d8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:40.311158 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1320ec5f-c0d1-440f-9624-979e7dca19d8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:40.317420 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1320ec5f-c0d1-440f-9624-979e7dca19d8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:40.317902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1320ec5f-c0d1-440f-9624-979e7dca19d8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:40.318688 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1320ec5f-c0d1-440f-9624-979e7dca19d8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:40.319116 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1320ec5f-c0d1-440f-9624-979e7dca19d8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:40.467625 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1320ec5f-c0d1-440f-9624-979e7dca19d8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:40.476021 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1320ec5f-c0d1-440f-9624-979e7dca19d8 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.170436 Dec 18 03:18:40.476591 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 405/838] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:40 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:40.976034 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-19499669-37c4-4c72-a6b4-5bba5915a512 req-b24dff36-38dc-46de-9732-afa235ba285c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ea4525-cf68-4ac8-9908-4857fde99da8", "name": "network-vif-plugged", "status": "completed", "tag": "9d73aaca-823a-46a8-a166-0001e8e95857"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:40.977608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:18:40.977608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:18:40.986547 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-19499669-37c4-4c72-a6b4-5bba5915a512 req-b24dff36-38dc-46de-9732-afa235ba285c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:40.987002 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-19499669-37c4-4c72-a6b4-5bba5915a512 req-b24dff36-38dc-46de-9732-afa235ba285c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:41.001463 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-19499669-37c4-4c72-a6b4-5bba5915a512 req-b24dff36-38dc-46de-9732-afa235ba285c service nova] Creating event network-vif-plugged:9d73aaca-823a-46a8-a166-0001e8e95857 for instance d6ea4525-cf68-4ac8-9908-4857fde99da8 on hv-cinder-81803 Dec 18 03:18:41.007779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-19499669-37c4-4c72-a6b4-5bba5915a512 req-b24dff36-38dc-46de-9732-afa235ba285c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035034 Dec 18 03:18:41.008371 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 434/839] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:18:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:18:41.150969 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:41.151486 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:41.157969 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:41.158415 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:41.159193 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:41.159661 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:41.352805 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:41.360913 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:41.362436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:41.363575 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c60c2484-ca43-4c30-8d0d-3ab79caf31f5 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.216416 Dec 18 03:18:41.364131 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 406/840] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:41 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:41.494417 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5367ecb5-6270-4b45-9f2c-1ad2b512aa8e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:41.495108 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5367ecb5-6270-4b45-9f2c-1ad2b512aa8e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:41.501818 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5367ecb5-6270-4b45-9f2c-1ad2b512aa8e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:41.502286 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5367ecb5-6270-4b45-9f2c-1ad2b512aa8e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:41.503051 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5367ecb5-6270-4b45-9f2c-1ad2b512aa8e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:41.503475 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5367ecb5-6270-4b45-9f2c-1ad2b512aa8e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:41.642260 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5367ecb5-6270-4b45-9f2c-1ad2b512aa8e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:41.649874 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5367ecb5-6270-4b45-9f2c-1ad2b512aa8e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.159420 Dec 18 03:18:41.650429 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 435/841] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:41 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:42.381946 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:42.382589 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:42.388978 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:42.389425 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:42.390243 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:42.390679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:42.529894 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:42.537805 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:42.539740 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:42.540721 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e96faeee-efa9-460a-8462-578d12818695 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1732 microversion: 2.20 time: 0.162521 Dec 18 03:18:42.541402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 407/842] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:42 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:42.667297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-aeee04b0-ede2-450e-bb77-dfffa74d3c89 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:42.668920 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-aeee04b0-ede2-450e-bb77-dfffa74d3c89 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:42.675391 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aeee04b0-ede2-450e-bb77-dfffa74d3c89 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:42.675837 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aeee04b0-ede2-450e-bb77-dfffa74d3c89 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:42.676618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aeee04b0-ede2-450e-bb77-dfffa74d3c89 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:42.677062 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aeee04b0-ede2-450e-bb77-dfffa74d3c89 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:42.821957 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-aeee04b0-ede2-450e-bb77-dfffa74d3c89 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:42.830037 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-aeee04b0-ede2-450e-bb77-dfffa74d3c89 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.166748 Dec 18 03:18:42.830702 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 436/843] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:42 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:43.559347 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:43.559904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:43.566188 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:43.566627 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:43.567424 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:43.567851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:43.701270 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:43.709212 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:43.711038 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:43.712452 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-590baeb5-9a72-453d-9f8a-a10cb179d876 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1719 microversion: 2.20 time: 0.157401 Dec 18 03:18:43.713120 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 408/844] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:18:43 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:18:43.847193 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-96653c34-32bb-4c86-b83a-3a5ddb863ce3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:43.847802 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-96653c34-32bb-4c86-b83a-3a5ddb863ce3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:43.854121 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-96653c34-32bb-4c86-b83a-3a5ddb863ce3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:43.854568 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-96653c34-32bb-4c86-b83a-3a5ddb863ce3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:43.855930 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-96653c34-32bb-4c86-b83a-3a5ddb863ce3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:43.856359 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-96653c34-32bb-4c86-b83a-3a5ddb863ce3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:44.003109 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-96653c34-32bb-4c86-b83a-3a5ddb863ce3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:44.010854 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-96653c34-32bb-4c86-b83a-3a5ddb863ce3 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.167305 Dec 18 03:18:44.011967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 437/845] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:43 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:45.029242 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9e2ecf50-120c-44b3-b156-aeb5a651bb25 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:45.030055 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9e2ecf50-120c-44b3-b156-aeb5a651bb25 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:45.036262 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9e2ecf50-120c-44b3-b156-aeb5a651bb25 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:45.036699 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9e2ecf50-120c-44b3-b156-aeb5a651bb25 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:45.037460 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9e2ecf50-120c-44b3-b156-aeb5a651bb25 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:45.037916 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9e2ecf50-120c-44b3-b156-aeb5a651bb25 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:45.179570 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9e2ecf50-120c-44b3-b156-aeb5a651bb25 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:45.187313 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9e2ecf50-120c-44b3-b156-aeb5a651bb25 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.162642 Dec 18 03:18:45.188040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 409/846] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:45 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:46.204565 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b3f5585b-d795-439f-b2fe-86bc1fc36eef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:46.205093 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b3f5585b-d795-439f-b2fe-86bc1fc36eef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:46.211511 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b3f5585b-d795-439f-b2fe-86bc1fc36eef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:46.211955 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b3f5585b-d795-439f-b2fe-86bc1fc36eef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:46.212722 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b3f5585b-d795-439f-b2fe-86bc1fc36eef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:46.213158 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b3f5585b-d795-439f-b2fe-86bc1fc36eef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:46.353980 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b3f5585b-d795-439f-b2fe-86bc1fc36eef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:46.362483 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b3f5585b-d795-439f-b2fe-86bc1fc36eef tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.161702 Dec 18 03:18:46.363050 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 438/847] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:46 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:47.379500 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7bd0e3e0-add8-4f81-b1d2-1ce1a14e8310 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:47.380101 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7bd0e3e0-add8-4f81-b1d2-1ce1a14e8310 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:47.387199 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7bd0e3e0-add8-4f81-b1d2-1ce1a14e8310 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:47.387638 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7bd0e3e0-add8-4f81-b1d2-1ce1a14e8310 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:47.388407 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7bd0e3e0-add8-4f81-b1d2-1ce1a14e8310 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:47.389020 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7bd0e3e0-add8-4f81-b1d2-1ce1a14e8310 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:47.532216 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7bd0e3e0-add8-4f81-b1d2-1ce1a14e8310 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:47.540146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7bd0e3e0-add8-4f81-b1d2-1ce1a14e8310 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.164229 Dec 18 03:18:47.540709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 410/848] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:47 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:48.557047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6776c13b-0e30-4358-8d59-9329ecfb8ca6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:48.557949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6776c13b-0e30-4358-8d59-9329ecfb8ca6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:48.564332 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6776c13b-0e30-4358-8d59-9329ecfb8ca6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:48.564796 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6776c13b-0e30-4358-8d59-9329ecfb8ca6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:48.565576 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6776c13b-0e30-4358-8d59-9329ecfb8ca6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:48.566046 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6776c13b-0e30-4358-8d59-9329ecfb8ca6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:48.714552 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6776c13b-0e30-4358-8d59-9329ecfb8ca6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:48.722660 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6776c13b-0e30-4358-8d59-9329ecfb8ca6 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.169330 Dec 18 03:18:48.723242 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 439/849] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:48 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:18:49.740346 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-34276bc5-66af-4e97-b163-c13e75acdd75 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:49.740958 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-34276bc5-66af-4e97-b163-c13e75acdd75 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:49.747753 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-34276bc5-66af-4e97-b163-c13e75acdd75 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:49.748198 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-34276bc5-66af-4e97-b163-c13e75acdd75 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:49.748978 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-34276bc5-66af-4e97-b163-c13e75acdd75 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:49.749411 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-34276bc5-66af-4e97-b163-c13e75acdd75 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:49.933579 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-34276bc5-66af-4e97-b163-c13e75acdd75 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:49.941592 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-34276bc5-66af-4e97-b163-c13e75acdd75 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.205166 Dec 18 03:18:49.942175 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 411/850] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:49 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:50.959343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0f1c1d37-b3d2-4212-8f23-c675bfdaca7d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:50.960060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0f1c1d37-b3d2-4212-8f23-c675bfdaca7d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:50.967120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0f1c1d37-b3d2-4212-8f23-c675bfdaca7d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:50.967667 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0f1c1d37-b3d2-4212-8f23-c675bfdaca7d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:50.968710 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0f1c1d37-b3d2-4212-8f23-c675bfdaca7d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:50.969350 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0f1c1d37-b3d2-4212-8f23-c675bfdaca7d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:51.171978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0f1c1d37-b3d2-4212-8f23-c675bfdaca7d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:51.179798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0f1c1d37-b3d2-4212-8f23-c675bfdaca7d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.224181 Dec 18 03:18:51.180445 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 440/851] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:50 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:52.198050 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-14056573-43fc-45e2-94ea-68de7fb11f16 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:52.199593 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-14056573-43fc-45e2-94ea-68de7fb11f16 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:52.206221 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-14056573-43fc-45e2-94ea-68de7fb11f16 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:52.206969 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-14056573-43fc-45e2-94ea-68de7fb11f16 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:52.208202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-14056573-43fc-45e2-94ea-68de7fb11f16 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:52.208861 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-14056573-43fc-45e2-94ea-68de7fb11f16 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:52.459806 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-14056573-43fc-45e2-94ea-68de7fb11f16 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:52.468047 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-14056573-43fc-45e2-94ea-68de7fb11f16 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1756 microversion: 2.1 time: 0.273793 Dec 18 03:18:52.468625 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 412/852] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:52 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1756 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:53.484280 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-46e9f50e-6540-4941-a4ee-b8f5aeb0536d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:18:53.485005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-46e9f50e-6540-4941-a4ee-b8f5aeb0536d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:18:53.491225 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46e9f50e-6540-4941-a4ee-b8f5aeb0536d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:53.491672 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46e9f50e-6540-4941-a4ee-b8f5aeb0536d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:53.492451 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46e9f50e-6540-4941-a4ee-b8f5aeb0536d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:18:53.492883 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-46e9f50e-6540-4941-a4ee-b8f5aeb0536d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:18:53.641886 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-46e9f50e-6540-4941-a4ee-b8f5aeb0536d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:18:53.651345 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-46e9f50e-6540-4941-a4ee-b8f5aeb0536d tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1759 microversion: 2.1 time: 0.170677 Dec 18 03:18:53.651927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 441/853] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:18:53 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:18:58.492813 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a6f535af-e975-4999-9856-e7f3cce05de2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Action: 'create', calling method: .version_select at 0x7fad262224c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1716447171"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:18:58.506923 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-a6f535af-e975-4999-9856-e7f3cce05de2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Getting quotas for project 400be51814e84a6e8a54033024fad790. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:18:58.511352 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-a6f535af-e975-4999-9856-e7f3cce05de2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Getting quotas for user 0622acc6ab6a44c4a82aa3b821bd814b and project 400be51814e84a6e8a54033024fad790. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:18:58.732257 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-a6f535af-e975-4999-9856-e7f3cce05de2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Getting quotas for project 400be51814e84a6e8a54033024fad790. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:18:58.736044 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-a6f535af-e975-4999-9856-e7f3cce05de2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Getting quotas for user 0622acc6ab6a44c4a82aa3b821bd814b and project 400be51814e84a6e8a54033024fad790. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:18:58.749083 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a6f535af-e975-4999-9856-e7f3cce05de2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.432390 Dec 18 03:18:58.749850 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 413/854] 10.222.0.24 () {60 vars in 1157 bytes} [Sat Dec 18 03:18:58 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:17.992097 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-511034899", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1716447171", "security_groups": [{"name": "tempest-secgroup-smoke-437878839"}], "networks": [{"uuid": "c87ce622-8636-4061-915a-93cc6dd10042"}], "block_device_mapping_v2": [{"uuid": "d75830f9-8daa-4c2a-94fe-df74dbd40fa3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:18.098806 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] validate_networks() for [('c87ce622-8636-4061-915a-93cc6dd10042', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:19:18.461594 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:19:18.462043 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:19:18.462505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:19:18.462906 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:19:18.464429 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:19:18.473862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:18.474319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:18.475133 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:18.475569 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:18.492326 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Getting quotas for project 400be51814e84a6e8a54033024fad790. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:19:18.497347 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Getting quotas for user 0622acc6ab6a44c4a82aa3b821bd814b and project 400be51814e84a6e8a54033024fad790. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:19:18.550652 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:19:18.552768 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d75830f9-8daa-4c2a-94fe-df74dbd40fa3',volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:19:18.670801 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-88b1e319-082c-43d8-9f23-e9e3c4dc97e6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.682441 Dec 18 03:19:18.671446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 442/855] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:19:17 2021] POST /compute/v2.1/servers => generated 405 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:19:18.681585 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-588f6055-d299-4433-8708-bf5ddaa72ba4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:18.682933 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-588f6055-d299-4433-8708-bf5ddaa72ba4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:18.734541 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-588f6055-d299-4433-8708-bf5ddaa72ba4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:18.740849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-588f6055-d299-4433-8708-bf5ddaa72ba4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1088 microversion: 2.1 time: 0.063462 Dec 18 03:19:18.741396 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 414/856] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:18 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:19:19.757650 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bb36bdac-be1f-445e-9dd4-bcec8bcfbc40 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:19.759865 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bb36bdac-be1f-445e-9dd4-bcec8bcfbc40 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:19.767968 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb36bdac-be1f-445e-9dd4-bcec8bcfbc40 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:19.768416 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb36bdac-be1f-445e-9dd4-bcec8bcfbc40 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:19.769452 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb36bdac-be1f-445e-9dd4-bcec8bcfbc40 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:19.770115 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb36bdac-be1f-445e-9dd4-bcec8bcfbc40 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:19.831867 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bb36bdac-be1f-445e-9dd4-bcec8bcfbc40 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:19.839585 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bb36bdac-be1f-445e-9dd4-bcec8bcfbc40 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1204 microversion: 2.1 time: 0.086077 Dec 18 03:19:19.840154 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 443/857] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:19 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:20.857468 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-45dba28f-9f4c-434e-8f3c-674c420b9494 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:20.858804 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-45dba28f-9f4c-434e-8f3c-674c420b9494 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:20.866336 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45dba28f-9f4c-434e-8f3c-674c420b9494 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:20.866802 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45dba28f-9f4c-434e-8f3c-674c420b9494 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:20.867600 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45dba28f-9f4c-434e-8f3c-674c420b9494 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:20.868035 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-45dba28f-9f4c-434e-8f3c-674c420b9494 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:21.079340 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-45dba28f-9f4c-434e-8f3c-674c420b9494 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:21.086675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-45dba28f-9f4c-434e-8f3c-674c420b9494 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.234164 Dec 18 03:19:21.087776 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 415/858] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:20 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:19:21.132925 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-06ad606a-854b-4c9a-afad-a2c9bbe246d3 req-bd6a5ed2-684a-4f10-bd86-a47e4c7e3e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d244df22-21b2-40e5-972f-e6678258f781", "tag": "60bc3098-1a05-43da-aad1-0105b3137056"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:21.135559 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:21.135559 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:19:21.145292 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-06ad606a-854b-4c9a-afad-a2c9bbe246d3 req-bd6a5ed2-684a-4f10-bd86-a47e4c7e3e1b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:21.145759 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-06ad606a-854b-4c9a-afad-a2c9bbe246d3 req-bd6a5ed2-684a-4f10-bd86-a47e4c7e3e1b service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:21.161912 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-06ad606a-854b-4c9a-afad-a2c9bbe246d3 req-bd6a5ed2-684a-4f10-bd86-a47e4c7e3e1b service nova] Creating event network-changed:60bc3098-1a05-43da-aad1-0105b3137056 for instance d244df22-21b2-40e5-972f-e6678258f781 on hv-cinder-81803 Dec 18 03:19:21.168098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-06ad606a-854b-4c9a-afad-a2c9bbe246d3 req-bd6a5ed2-684a-4f10-bd86-a47e4c7e3e1b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039643 Dec 18 03:19:21.169063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 444/859] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:19:22.104161 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c2ca3716-f3b3-4bde-9731-37c9f545e8b4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:22.104787 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c2ca3716-f3b3-4bde-9731-37c9f545e8b4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:22.111527 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c2ca3716-f3b3-4bde-9731-37c9f545e8b4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:22.112008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c2ca3716-f3b3-4bde-9731-37c9f545e8b4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:22.112783 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c2ca3716-f3b3-4bde-9731-37c9f545e8b4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:22.113261 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c2ca3716-f3b3-4bde-9731-37c9f545e8b4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:22.269680 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c2ca3716-f3b3-4bde-9731-37c9f545e8b4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:22.276970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c2ca3716-f3b3-4bde-9731-37c9f545e8b4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.176697 Dec 18 03:19:22.277675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 416/860] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:22 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:22.504991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6c0922bb-ebdc-4dfb-a376-0725b574128d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:22.506005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6c0922bb-ebdc-4dfb-a376-0725b574128d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:22.512612 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c0922bb-ebdc-4dfb-a376-0725b574128d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:22.513051 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c0922bb-ebdc-4dfb-a376-0725b574128d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:22.513850 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c0922bb-ebdc-4dfb-a376-0725b574128d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:22.514274 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c0922bb-ebdc-4dfb-a376-0725b574128d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:22.541856 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6c0922bb-ebdc-4dfb-a376-0725b574128d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041275 Dec 18 03:19:22.542406 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 445/861] 10.222.0.24 () {60 vars in 1342 bytes} [Sat Dec 18 03:19:22 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:22.595905 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-86da748a-1215-48f5-be5b-f9c433267930 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:22.596394 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-86da748a-1215-48f5-be5b-f9c433267930 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:22.602156 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86da748a-1215-48f5-be5b-f9c433267930 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:22.602625 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86da748a-1215-48f5-be5b-f9c433267930 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:22.603419 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86da748a-1215-48f5-be5b-f9c433267930 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:22.604068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86da748a-1215-48f5-be5b-f9c433267930 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:22.628550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-86da748a-1215-48f5-be5b-f9c433267930 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Going to try to terminate instance {{(pid=116000) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:19:22.702676 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-86da748a-1215-48f5-be5b-f9c433267930 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 204 len: 0 microversion: 2.20 time: 0.110037 Dec 18 03:19:22.703509 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 417/862] 10.222.0.24 () {60 vars in 1279 bytes} [Sat Dec 18 03:19:22 2021] DELETE /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 03:19:22.712593 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:22.713202 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:22.719214 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:22.719658 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:22.720429 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:22.720868 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:22.852950 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:22.861397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:22.862910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:22.864049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-fa9a8e2f-f9ca-4bb4-b839-c15cc1312d45 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.155210 Dec 18 03:19:22.864603 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 446/863] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:19:22 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:19:23.294588 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-82567d48-2e5d-4105-a300-93a98f8f5c07 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:23.295291 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-82567d48-2e5d-4105-a300-93a98f8f5c07 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:23.301597 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-82567d48-2e5d-4105-a300-93a98f8f5c07 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:23.302090 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-82567d48-2e5d-4105-a300-93a98f8f5c07 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:23.302861 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-82567d48-2e5d-4105-a300-93a98f8f5c07 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:23.303288 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-82567d48-2e5d-4105-a300-93a98f8f5c07 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:23.438212 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-82567d48-2e5d-4105-a300-93a98f8f5c07 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:23.445379 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-82567d48-2e5d-4105-a300-93a98f8f5c07 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.155621 Dec 18 03:19:23.445968 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 418/864] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:23 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:23.882315 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:23.882947 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:23.889901 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:23.890343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:23.891109 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:23.891539 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:24.016825 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:24.024319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:24.026487 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:24.027617 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-95b32311-5dc5-4f08-9308-5e63be1fbd0f tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1725 microversion: 2.20 time: 0.148966 Dec 18 03:19:24.028162 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 447/865] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:19:23 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 18 03:19:24.462453 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d2a9e288-ac51-469b-8dc1-5067eb45acf9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:24.463685 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d2a9e288-ac51-469b-8dc1-5067eb45acf9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:24.470787 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d2a9e288-ac51-469b-8dc1-5067eb45acf9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:24.471231 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d2a9e288-ac51-469b-8dc1-5067eb45acf9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:24.472039 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d2a9e288-ac51-469b-8dc1-5067eb45acf9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:24.472467 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d2a9e288-ac51-469b-8dc1-5067eb45acf9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:24.705928 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d2a9e288-ac51-469b-8dc1-5067eb45acf9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:24.714433 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d2a9e288-ac51-469b-8dc1-5067eb45acf9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.254965 Dec 18 03:19:24.714433 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 419/866] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:24 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:25.045647 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:25.046273 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:25.052516 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:25.052966 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:25.053774 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:25.054213 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:25.121654 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:25.130291 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:25.132225 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eab89208d73e45878ea797026c7741f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f27614e91de40f2ba636e557961e94f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:25.133592 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8ba6f9d7-abdd-4adf-8b04-5af298d55e1d tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 200 len: 1657 microversion: 2.20 time: 0.091779 Dec 18 03:19:25.136063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 448/867] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:19:25 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 1657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 18 03:19:25.368353 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-c586b5c3-c6bf-40b6-9339-930fb46db3e3 req-0d01c151-2a09-49dc-bf6b-74393061d59c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ea4525-cf68-4ac8-9908-4857fde99da8", "name": "network-vif-deleted", "tag": "9d73aaca-823a-46a8-a166-0001e8e95857"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:25.370873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:25.370873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:19:25.379152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-c586b5c3-c6bf-40b6-9339-930fb46db3e3 req-0d01c151-2a09-49dc-bf6b-74393061d59c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:25.379669 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-c586b5c3-c6bf-40b6-9339-930fb46db3e3 req-0d01c151-2a09-49dc-bf6b-74393061d59c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:25.392099 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-c586b5c3-c6bf-40b6-9339-930fb46db3e3 req-0d01c151-2a09-49dc-bf6b-74393061d59c service nova] Creating event network-vif-deleted:9d73aaca-823a-46a8-a166-0001e8e95857 for instance d6ea4525-cf68-4ac8-9908-4857fde99da8 on hv-cinder-81803 Dec 18 03:19:25.396860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-c586b5c3-c6bf-40b6-9339-930fb46db3e3 req-0d01c151-2a09-49dc-bf6b-74393061d59c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 Dec 18 03:19:25.397453 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 420/868] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:19:25.730095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7f6c3167-cebd-4255-ba3b-681e481ad4d4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:25.730706 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7f6c3167-cebd-4255-ba3b-681e481ad4d4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:25.736549 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f6c3167-cebd-4255-ba3b-681e481ad4d4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:25.736991 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f6c3167-cebd-4255-ba3b-681e481ad4d4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:25.737785 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f6c3167-cebd-4255-ba3b-681e481ad4d4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:25.738209 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f6c3167-cebd-4255-ba3b-681e481ad4d4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:25.874943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7f6c3167-cebd-4255-ba3b-681e481ad4d4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:25.882838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7f6c3167-cebd-4255-ba3b-681e481ad4d4 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.156664 Dec 18 03:19:25.883415 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 449/869] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:25 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:26.156041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a8509535-6517-4db8-9bee-755aa9dee508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:26.156970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a8509535-6517-4db8-9bee-755aa9dee508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:26.163382 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a8509535-6517-4db8-9bee-755aa9dee508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:26.163834 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a8509535-6517-4db8-9bee-755aa9dee508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:26.164628 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a8509535-6517-4db8-9bee-755aa9dee508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:26.165065 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a8509535-6517-4db8-9bee-755aa9dee508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:26.179199 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-a8509535-6517-4db8-9bee-755aa9dee508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] HTTP exception thrown: Instance d6ea4525-cf68-4ac8-9908-4857fde99da8 could not be found. Dec 18 03:19:26.179803 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a8509535-6517-4db8-9bee-755aa9dee508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Returning 404 to user: Instance d6ea4525-cf68-4ac8-9908-4857fde99da8 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:19:26.180633 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a8509535-6517-4db8-9bee-755aa9dee508 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 404 len: 111 microversion: 2.20 time: 0.029168 Dec 18 03:19:26.181196 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 421/870] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:19:26 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:19:26.189933 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7f7d10ad-9ae6-46b3-ae37-9d1d8e072f60 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '.version_select at 0x7fad2611fa60>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:26.210584 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7f7d10ad-9ae6-46b3-ae37-9d1d8e072f60 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459014602" status: 204 len: 0 microversion: 2.20 time: 0.024274 Dec 18 03:19:26.211170 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 450/871] 10.222.0.24 () {60 vars in 1261 bytes} [Sat Dec 18 03:19:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459014602 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 18 03:19:26.899658 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-fbcc77f3-fe0a-46b6-868d-073db6b1a93e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:26.901228 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-fbcc77f3-fe0a-46b6-868d-073db6b1a93e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:26.907914 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fbcc77f3-fe0a-46b6-868d-073db6b1a93e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:26.908378 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fbcc77f3-fe0a-46b6-868d-073db6b1a93e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:26.909229 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fbcc77f3-fe0a-46b6-868d-073db6b1a93e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:26.909679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-fbcc77f3-fe0a-46b6-868d-073db6b1a93e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:27.040406 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-fbcc77f3-fe0a-46b6-868d-073db6b1a93e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:27.048161 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-fbcc77f3-fe0a-46b6-868d-073db6b1a93e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.152139 Dec 18 03:19:27.048720 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 422/872] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:26 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:27.936379 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8759467b-5ec5-4959-b070-ed4f77cafda2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:27.936880 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8759467b-5ec5-4959-b070-ed4f77cafda2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:27.943747 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8759467b-5ec5-4959-b070-ed4f77cafda2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:27.944188 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8759467b-5ec5-4959-b070-ed4f77cafda2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:27.944950 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8759467b-5ec5-4959-b070-ed4f77cafda2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:27.945377 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8759467b-5ec5-4959-b070-ed4f77cafda2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:27.958264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-8759467b-5ec5-4959-b070-ed4f77cafda2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] HTTP exception thrown: Instance d6ea4525-cf68-4ac8-9908-4857fde99da8 could not be found. Dec 18 03:19:27.958843 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8759467b-5ec5-4959-b070-ed4f77cafda2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Returning 404 to user: Instance d6ea4525-cf68-4ac8-9908-4857fde99da8 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:19:27.959638 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8759467b-5ec5-4959-b070-ed4f77cafda2 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 404 len: 111 microversion: 2.20 time: 0.027149 Dec 18 03:19:27.960155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 451/873] 10.222.0.24 () {60 vars in 1279 bytes} [Sat Dec 18 03:19:27 2021] DELETE /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:19:27.967985 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-83de43bb-fbba-4e69-9408-2053c9a7a919 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:27.968599 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-83de43bb-fbba-4e69-9408-2053c9a7a919 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: d6ea4525-cf68-4ac8-9908-4857fde99da8] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:27.974810 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-83de43bb-fbba-4e69-9408-2053c9a7a919 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:27.975253 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-83de43bb-fbba-4e69-9408-2053c9a7a919 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:27.976024 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-83de43bb-fbba-4e69-9408-2053c9a7a919 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:27.976459 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-83de43bb-fbba-4e69-9408-2053c9a7a919 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:27.990125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-83de43bb-fbba-4e69-9408-2053c9a7a919 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] HTTP exception thrown: Instance d6ea4525-cf68-4ac8-9908-4857fde99da8 could not be found. Dec 18 03:19:27.990700 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-83de43bb-fbba-4e69-9408-2053c9a7a919 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Returning 404 to user: Instance d6ea4525-cf68-4ac8-9908-4857fde99da8 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:19:27.991519 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-83de43bb-fbba-4e69-9408-2053c9a7a919 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8" status: 404 len: 111 microversion: 2.20 time: 0.027168 Dec 18 03:19:27.992061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 423/874] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:19:27 2021] GET /compute/v2.1/servers/d6ea4525-cf68-4ac8-9908-4857fde99da8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:19:28.063916 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-325e9990-04c3-43c7-90a5-8b5674342b60 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:28.065528 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-325e9990-04c3-43c7-90a5-8b5674342b60 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:28.072436 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-325e9990-04c3-43c7-90a5-8b5674342b60 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:28.072927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-325e9990-04c3-43c7-90a5-8b5674342b60 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:28.073921 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-325e9990-04c3-43c7-90a5-8b5674342b60 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:28.074369 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-325e9990-04c3-43c7-90a5-8b5674342b60 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:28.206159 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-325e9990-04c3-43c7-90a5-8b5674342b60 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:28.213508 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-325e9990-04c3-43c7-90a5-8b5674342b60 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.153043 Dec 18 03:19:28.214095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 452/875] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:28 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:29.116348 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-be5ec045-fb4e-460f-8890-8688c8adc402 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:29.116842 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-be5ec045-fb4e-460f-8890-8688c8adc402 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:29.123866 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be5ec045-fb4e-460f-8890-8688c8adc402 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:29.124312 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be5ec045-fb4e-460f-8890-8688c8adc402 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:29.125097 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be5ec045-fb4e-460f-8890-8688c8adc402 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:29.125528 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-be5ec045-fb4e-460f-8890-8688c8adc402 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:29.139260 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-be5ec045-fb4e-460f-8890-8688c8adc402 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] HTTP exception thrown: Instance aaa82caa-8340-4f50-9989-2ddbc243fb40 could not be found. Dec 18 03:19:29.139879 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-be5ec045-fb4e-460f-8890-8688c8adc402 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Returning 404 to user: Instance aaa82caa-8340-4f50-9989-2ddbc243fb40 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:19:29.140698 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-be5ec045-fb4e-460f-8890-8688c8adc402 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "DELETE /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 404 len: 111 microversion: 2.20 time: 0.028027 Dec 18 03:19:29.141228 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 424/876] 10.222.0.24 () {60 vars in 1279 bytes} [Sat Dec 18 03:19:29 2021] DELETE /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 18 03:19:29.148956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ae06cf18-d22c-427a-9433-8cb7fc59fe29 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:29.149558 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ae06cf18-d22c-427a-9433-8cb7fc59fe29 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] [instance: aaa82caa-8340-4f50-9989-2ddbc243fb40] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:29.156047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ae06cf18-d22c-427a-9433-8cb7fc59fe29 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:29.156488 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ae06cf18-d22c-427a-9433-8cb7fc59fe29 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:29.157249 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ae06cf18-d22c-427a-9433-8cb7fc59fe29 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:29.157713 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ae06cf18-d22c-427a-9433-8cb7fc59fe29 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:29.170860 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-ae06cf18-d22c-427a-9433-8cb7fc59fe29 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] HTTP exception thrown: Instance aaa82caa-8340-4f50-9989-2ddbc243fb40 could not be found. Dec 18 03:19:29.171437 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ae06cf18-d22c-427a-9433-8cb7fc59fe29 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] Returning 404 to user: Instance aaa82caa-8340-4f50-9989-2ddbc243fb40 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:19:29.172243 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ae06cf18-d22c-427a-9433-8cb7fc59fe29 tempest-AttachVolumeShelveTestJSON-1065630468 tempest-AttachVolumeShelveTestJSON-1065630468-project] 10.222.0.24 "GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40" status: 404 len: 111 microversion: 2.20 time: 0.026916 Dec 18 03:19:29.172785 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 453/877] 10.222.0.24 () {60 vars in 1276 bytes} [Sat Dec 18 03:19:29 2021] GET /compute/v2.1/servers/aaa82caa-8340-4f50-9989-2ddbc243fb40 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 18 03:19:29.230585 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ea7f3e07-cc15-4eb2-b3b4-2e2bce96324d tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:29.231327 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ea7f3e07-cc15-4eb2-b3b4-2e2bce96324d tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:29.237533 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ea7f3e07-cc15-4eb2-b3b4-2e2bce96324d tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:29.238091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ea7f3e07-cc15-4eb2-b3b4-2e2bce96324d tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:29.239140 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ea7f3e07-cc15-4eb2-b3b4-2e2bce96324d tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:29.239730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ea7f3e07-cc15-4eb2-b3b4-2e2bce96324d tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:29.719273 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ea7f3e07-cc15-4eb2-b3b4-2e2bce96324d tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:29.727257 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ea7f3e07-cc15-4eb2-b3b4-2e2bce96324d tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.500457 Dec 18 03:19:29.727820 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 425/878] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:29 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:30.743474 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8b9a9f1a-f0d9-4d83-8f91-da9ac2e17465 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:30.744241 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8b9a9f1a-f0d9-4d83-8f91-da9ac2e17465 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:30.750525 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8b9a9f1a-f0d9-4d83-8f91-da9ac2e17465 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:30.750972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8b9a9f1a-f0d9-4d83-8f91-da9ac2e17465 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:30.751748 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8b9a9f1a-f0d9-4d83-8f91-da9ac2e17465 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:30.752191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8b9a9f1a-f0d9-4d83-8f91-da9ac2e17465 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:30.888648 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8b9a9f1a-f0d9-4d83-8f91-da9ac2e17465 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:30.895956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8b9a9f1a-f0d9-4d83-8f91-da9ac2e17465 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.156116 Dec 18 03:19:30.896510 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 454/879] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:30 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:31.550701 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-9ff0ba8a-ba49-4747-bfab-2808afc1212a req-f4998f47-b4c3-4e2f-b55a-71ded275477e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d244df22-21b2-40e5-972f-e6678258f781", "name": "network-vif-plugged", "status": "completed", "tag": "60bc3098-1a05-43da-aad1-0105b3137056"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:31.552635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:31.552635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:19:31.567244 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-9ff0ba8a-ba49-4747-bfab-2808afc1212a req-f4998f47-b4c3-4e2f-b55a-71ded275477e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:31.568053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-9ff0ba8a-ba49-4747-bfab-2808afc1212a req-f4998f47-b4c3-4e2f-b55a-71ded275477e service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:31.581257 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-9ff0ba8a-ba49-4747-bfab-2808afc1212a req-f4998f47-b4c3-4e2f-b55a-71ded275477e service nova] Creating event network-vif-plugged:60bc3098-1a05-43da-aad1-0105b3137056 for instance d244df22-21b2-40e5-972f-e6678258f781 on hv-cinder-81803 Dec 18 03:19:31.587499 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-9ff0ba8a-ba49-4747-bfab-2808afc1212a req-f4998f47-b4c3-4e2f-b55a-71ded275477e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040080 Dec 18 03:19:31.588111 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 426/880] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:19:31.912127 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b7e3327c-eda7-447b-9aa3-68c03aa1c297 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:31.912852 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b7e3327c-eda7-447b-9aa3-68c03aa1c297 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:31.919382 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7e3327c-eda7-447b-9aa3-68c03aa1c297 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:31.919898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7e3327c-eda7-447b-9aa3-68c03aa1c297 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:31.920804 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7e3327c-eda7-447b-9aa3-68c03aa1c297 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:31.921298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7e3327c-eda7-447b-9aa3-68c03aa1c297 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:32.055024 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b7e3327c-eda7-447b-9aa3-68c03aa1c297 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:32.062290 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b7e3327c-eda7-447b-9aa3-68c03aa1c297 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.153861 Dec 18 03:19:32.063006 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 455/881] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:31 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:32.678202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e39b7045-dd95-45e9-882a-e1092429a870 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-399143997"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:32.679508 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e39b7045-dd95-45e9-882a-e1092429a870 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:32.687779 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e39b7045-dd95-45e9-882a-e1092429a870 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:32.688225 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e39b7045-dd95-45e9-882a-e1092429a870 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:32.689017 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e39b7045-dd95-45e9-882a-e1092429a870 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:32.689463 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e39b7045-dd95-45e9-882a-e1092429a870 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:33.066516 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.network.security_group_api [None req-e39b7045-dd95-45e9-882a-e1092429a870 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Removing security group e19d6e20-2ce3-4920-96c8-19b85354b322 from port 86879b2c-8d5c-4c8e-b9e7-e91bea976d75 Dec 18 03:19:33.078978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-20bea8a6-e106-4943-9f63-dddad4e9b1c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:33.079601 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-20bea8a6-e106-4943-9f63-dddad4e9b1c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:33.086017 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-20bea8a6-e106-4943-9f63-dddad4e9b1c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:33.086467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-20bea8a6-e106-4943-9f63-dddad4e9b1c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:33.087248 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-20bea8a6-e106-4943-9f63-dddad4e9b1c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:33.088236 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-20bea8a6-e106-4943-9f63-dddad4e9b1c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:33.499545 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e39b7045-dd95-45e9-882a-e1092429a870 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "POST /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/action" status: 202 len: 0 microversion: 2.1 time: 0.828146 Dec 18 03:19:33.500627 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 427/882] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:19:32 2021] POST /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:19:33.511435 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-a16fc76a-8752-4a05-ad80-bf0ac41dae21 req-a96eb63d-a356-4454-9b7b-99ed16c58d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83329381-8624-4e96-a968-8f2de6818b11", "tag": "86879b2c-8d5c-4c8e-b9e7-e91bea976d75"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:33.513207 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:33.513207 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:19:33.529701 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-a16fc76a-8752-4a05-ad80-bf0ac41dae21 req-a96eb63d-a356-4454-9b7b-99ed16c58d60 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:33.530148 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-a16fc76a-8752-4a05-ad80-bf0ac41dae21 req-a96eb63d-a356-4454-9b7b-99ed16c58d60 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:33.538426 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-20bea8a6-e106-4943-9f63-dddad4e9b1c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:33.547888 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-20bea8a6-e106-4943-9f63-dddad4e9b1c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1259 microversion: 2.1 time: 0.472450 Dec 18 03:19:33.559100 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 456/883] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:33 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1259 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:19:33.568008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-a16fc76a-8752-4a05-ad80-bf0ac41dae21 req-a96eb63d-a356-4454-9b7b-99ed16c58d60 service nova] Creating event network-changed:86879b2c-8d5c-4c8e-b9e7-e91bea976d75 for instance 83329381-8624-4e96-a968-8f2de6818b11 on hv-cinder-81803 Dec 18 03:19:33.576678 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-a16fc76a-8752-4a05-ad80-bf0ac41dae21 req-a96eb63d-a356-4454-9b7b-99ed16c58d60 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070359 Dec 18 03:19:33.577282 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 428/884] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:19:34.565476 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ca6a8d25-f4a8-45cc-8016-ba434ff05c6f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:34.566858 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ca6a8d25-f4a8-45cc-8016-ba434ff05c6f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:34.573806 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ca6a8d25-f4a8-45cc-8016-ba434ff05c6f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:34.574274 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ca6a8d25-f4a8-45cc-8016-ba434ff05c6f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:34.575086 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ca6a8d25-f4a8-45cc-8016-ba434ff05c6f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:34.575811 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ca6a8d25-f4a8-45cc-8016-ba434ff05c6f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:34.779009 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ca6a8d25-f4a8-45cc-8016-ba434ff05c6f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:34.787703 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ca6a8d25-f4a8-45cc-8016-ba434ff05c6f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1443 microversion: 2.1 time: 0.225961 Dec 18 03:19:34.788845 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 457/885] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:34 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1443 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:19:34.805725 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c21a2b0f-1827-41f6-afba-1bc63cf21729 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:34.807137 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c21a2b0f-1827-41f6-afba-1bc63cf21729 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:34.813938 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c21a2b0f-1827-41f6-afba-1bc63cf21729 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:34.814731 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c21a2b0f-1827-41f6-afba-1bc63cf21729 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:34.815605 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c21a2b0f-1827-41f6-afba-1bc63cf21729 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:34.816135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c21a2b0f-1827-41f6-afba-1bc63cf21729 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:34.930525 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b5932f63-f1ab-4a61-bdac-aa1051f687fb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:34.932251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b5932f63-f1ab-4a61-bdac-aa1051f687fb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:34.939601 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b5932f63-f1ab-4a61-bdac-aa1051f687fb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:34.940049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b5932f63-f1ab-4a61-bdac-aa1051f687fb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:34.940844 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b5932f63-f1ab-4a61-bdac-aa1051f687fb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:34.941280 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b5932f63-f1ab-4a61-bdac-aa1051f687fb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:35.047784 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-b5932f63-f1ab-4a61-bdac-aa1051f687fb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lazy-loading 'services' on Instance uuid 83329381-8624-4e96-a968-8f2de6818b11 {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:19:35.095342 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c21a2b0f-1827-41f6-afba-1bc63cf21729 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:35.106662 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c21a2b0f-1827-41f6-afba-1bc63cf21729 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1443 microversion: 2.1 time: 0.304851 Dec 18 03:19:35.108266 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 429/886] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:34 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1443 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:19:35.114030 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-4d78eefc-2235-47fa-8951-44fd35dc57dd req-2fcea043-04ba-4240-b689-d787292b09a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83329381-8624-4e96-a968-8f2de6818b11", "tag": "86879b2c-8d5c-4c8e-b9e7-e91bea976d75"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:35.115883 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:35.115883 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:19:35.124330 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-4d78eefc-2235-47fa-8951-44fd35dc57dd req-2fcea043-04ba-4240-b689-d787292b09a0 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:35.124995 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-4d78eefc-2235-47fa-8951-44fd35dc57dd req-2fcea043-04ba-4240-b689-d787292b09a0 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:35.159805 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-4d78eefc-2235-47fa-8951-44fd35dc57dd req-2fcea043-04ba-4240-b689-d787292b09a0 service nova] Creating event network-changed:86879b2c-8d5c-4c8e-b9e7-e91bea976d75 for instance 83329381-8624-4e96-a968-8f2de6818b11 on hv-cinder-81803 Dec 18 03:19:35.166921 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-4d78eefc-2235-47fa-8951-44fd35dc57dd req-2fcea043-04ba-4240-b689-d787292b09a0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056814 Dec 18 03:19:35.167905 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 430/887] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:19:35.187302 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b5932f63-f1ab-4a61-bdac-aa1051f687fb tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "DELETE /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments/daf95b27-f4aa-451f-9e4c-ea9fc416dceb" status: 202 len: 0 microversion: 2.1 time: 0.260178 Dec 18 03:19:35.188088 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 458/888] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:19:34 2021] DELETE /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments/daf95b27-f4aa-451f-9e4c-ea9fc416dceb => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:19:35.197866 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0e83f414-e980-4898-ac74-dd0fca6505c1 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:35.199157 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0e83f414-e980-4898-ac74-dd0fca6505c1 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:35.218449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0e83f414-e980-4898-ac74-dd0fca6505c1 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:35.219214 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0e83f414-e980-4898-ac74-dd0fca6505c1 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:35.220018 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0e83f414-e980-4898-ac74-dd0fca6505c1 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:35.220456 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0e83f414-e980-4898-ac74-dd0fca6505c1 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:35.255608 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0e83f414-e980-4898-ac74-dd0fca6505c1 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062796 Dec 18 03:19:35.260454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 431/889] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:19:35 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:19:36.269482 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-49b80b71-5869-4fdc-b8af-22607eb3e97c tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:36.271415 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-49b80b71-5869-4fdc-b8af-22607eb3e97c tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:36.285031 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-49b80b71-5869-4fdc-b8af-22607eb3e97c tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:36.286172 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-49b80b71-5869-4fdc-b8af-22607eb3e97c tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:36.287293 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-49b80b71-5869-4fdc-b8af-22607eb3e97c tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:36.287987 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-49b80b71-5869-4fdc-b8af-22607eb3e97c tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:36.330838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-49b80b71-5869-4fdc-b8af-22607eb3e97c tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066862 Dec 18 03:19:36.354693 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7667b415-cde8-45ac-8864-49a649c9093b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:36.360850 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7667b415-cde8-45ac-8864-49a649c9093b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:36.363545 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 459/890] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:19:36 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:19:36.372349 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7667b415-cde8-45ac-8864-49a649c9093b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:36.373913 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7667b415-cde8-45ac-8864-49a649c9093b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:36.375595 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7667b415-cde8-45ac-8864-49a649c9093b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:36.376270 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7667b415-cde8-45ac-8864-49a649c9093b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:36.534639 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-7667b415-cde8-45ac-8864-49a649c9093b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] HTTP exception thrown: Instance 83329381-8624-4e96-a968-8f2de6818b11 is not attached to volume daf95b27-f4aa-451f-9e4c-ea9fc416dceb Dec 18 03:19:36.535404 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7667b415-cde8-45ac-8864-49a649c9093b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Returning 404 to user: Instance 83329381-8624-4e96-a968-8f2de6818b11 is not attached to volume daf95b27-f4aa-451f-9e4c-ea9fc416dceb {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:19:36.539652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7667b415-cde8-45ac-8864-49a649c9093b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "DELETE /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments/daf95b27-f4aa-451f-9e4c-ea9fc416dceb" status: 404 len: 154 microversion: 2.1 time: 0.195664 Dec 18 03:19:36.541629 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 432/891] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:19:36 2021] DELETE /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11/os-volume_attachments/daf95b27-f4aa-451f-9e4c-ea9fc416dceb => generated 154 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:19:37.624748 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-df80c1bd-b87e-459d-a4b0-3cdf96027d51 req-baa8394c-2d4d-4ba7-baa5-597cd8494ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d244df22-21b2-40e5-972f-e6678258f781", "tag": "60bc3098-1a05-43da-aad1-0105b3137056"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:37.626600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:37.626600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:19:37.636280 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-df80c1bd-b87e-459d-a4b0-3cdf96027d51 req-baa8394c-2d4d-4ba7-baa5-597cd8494ad9 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:37.636867 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-df80c1bd-b87e-459d-a4b0-3cdf96027d51 req-baa8394c-2d4d-4ba7-baa5-597cd8494ad9 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:37.649528 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-df80c1bd-b87e-459d-a4b0-3cdf96027d51 req-baa8394c-2d4d-4ba7-baa5-597cd8494ad9 service nova] Creating event network-changed:60bc3098-1a05-43da-aad1-0105b3137056 for instance d244df22-21b2-40e5-972f-e6678258f781 on hv-cinder-81803 Dec 18 03:19:37.656480 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-df80c1bd-b87e-459d-a4b0-3cdf96027d51 req-baa8394c-2d4d-4ba7-baa5-597cd8494ad9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035598 Dec 18 03:19:37.660752 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 460/892] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:19:37.730322 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1f69b0fd-2a34-42fd-8857-0b07eb5e2b80 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:37.731528 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1f69b0fd-2a34-42fd-8857-0b07eb5e2b80 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:37.738604 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1f69b0fd-2a34-42fd-8857-0b07eb5e2b80 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:37.739459 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1f69b0fd-2a34-42fd-8857-0b07eb5e2b80 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:37.740515 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1f69b0fd-2a34-42fd-8857-0b07eb5e2b80 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:37.741215 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1f69b0fd-2a34-42fd-8857-0b07eb5e2b80 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:37.772602 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1f69b0fd-2a34-42fd-8857-0b07eb5e2b80 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Going to try to terminate instance {{(pid=116000) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:19:37.896081 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1f69b0fd-2a34-42fd-8857-0b07eb5e2b80 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "DELETE /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 204 len: 0 microversion: 2.1 time: 0.172513 Dec 18 03:19:37.896670 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 433/893] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:19:37 2021] DELETE /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:19:37.906142 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ede589a5-c201-4974-b724-8fd9feb2df19 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:37.907262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ede589a5-c201-4974-b724-8fd9feb2df19 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:37.914024 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ede589a5-c201-4974-b724-8fd9feb2df19 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:37.914890 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ede589a5-c201-4974-b724-8fd9feb2df19 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:37.916043 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ede589a5-c201-4974-b724-8fd9feb2df19 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:37.916738 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ede589a5-c201-4974-b724-8fd9feb2df19 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:38.074602 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ede589a5-c201-4974-b724-8fd9feb2df19 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:38.097956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ede589a5-c201-4974-b724-8fd9feb2df19 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1554 microversion: 2.1 time: 0.195657 Dec 18 03:19:38.099944 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 461/894] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:37 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:39.116994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-591993db-1a84-4898-a0d9-acb532ebdace tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:39.117719 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-591993db-1a84-4898-a0d9-acb532ebdace tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:39.124217 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-591993db-1a84-4898-a0d9-acb532ebdace tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:39.124666 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-591993db-1a84-4898-a0d9-acb532ebdace tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:39.125613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-591993db-1a84-4898-a0d9-acb532ebdace tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:39.126140 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-591993db-1a84-4898-a0d9-acb532ebdace tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:39.445911 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-591993db-1a84-4898-a0d9-acb532ebdace tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:39.456091 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-591993db-1a84-4898-a0d9-acb532ebdace tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1554 microversion: 2.1 time: 0.343006 Dec 18 03:19:39.457013 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 434/895] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:39 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1554 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:40.473715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0580eb39-2117-44b9-b8ea-d4da0ac7df34 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:40.474919 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0580eb39-2117-44b9-b8ea-d4da0ac7df34 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:40.482838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0580eb39-2117-44b9-b8ea-d4da0ac7df34 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:40.483512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0580eb39-2117-44b9-b8ea-d4da0ac7df34 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:40.484495 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0580eb39-2117-44b9-b8ea-d4da0ac7df34 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:40.485092 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0580eb39-2117-44b9-b8ea-d4da0ac7df34 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:40.557687 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0580eb39-2117-44b9-b8ea-d4da0ac7df34 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7c4549cb461a9584bec015c9b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535faa61f3e345e6be0cc8a3f85fb207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:40.569371 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0580eb39-2117-44b9-b8ea-d4da0ac7df34 tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 200 len: 1512 microversion: 2.1 time: 0.098852 Dec 18 03:19:40.569859 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 462/896] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:40 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 1512 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:40.625218 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-d9cfd91d-2d79-48bd-beb8-c9a7573bcc53 req-1578fe02-6124-4545-be64-67bffc8ad0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83329381-8624-4e96-a968-8f2de6818b11", "name": "network-vif-deleted", "tag": "86879b2c-8d5c-4c8e-b9e7-e91bea976d75"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:40.626881 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:40.626881 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:19:40.635287 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-d9cfd91d-2d79-48bd-beb8-c9a7573bcc53 req-1578fe02-6124-4545-be64-67bffc8ad0d3 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:40.636015 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-d9cfd91d-2d79-48bd-beb8-c9a7573bcc53 req-1578fe02-6124-4545-be64-67bffc8ad0d3 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:40.651888 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-d9cfd91d-2d79-48bd-beb8-c9a7573bcc53 req-1578fe02-6124-4545-be64-67bffc8ad0d3 service nova] Creating event network-vif-deleted:86879b2c-8d5c-4c8e-b9e7-e91bea976d75 for instance 83329381-8624-4e96-a968-8f2de6818b11 on hv-cinder-81803 Dec 18 03:19:40.658194 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-d9cfd91d-2d79-48bd-beb8-c9a7573bcc53 req-1578fe02-6124-4545-be64-67bffc8ad0d3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036861 Dec 18 03:19:40.661799 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 463/897] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:19:40.700902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-db6f5b97-d5ab-4644-94ca-72cf6ca35ee0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'create', calling method: .version_select at 0x7fad26265b80>, body: {"keypair": {"name": "tempest-keypair-2087650046"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:40.716725 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-db6f5b97-d5ab-4644-94ca-72cf6ca35ee0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:19:40.724635 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-db6f5b97-d5ab-4644-94ca-72cf6ca35ee0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for user 3c719df3f54e442790c9a6c9d1e687e9 and project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:19:40.831796 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-db6f5b97-d5ab-4644-94ca-72cf6ca35ee0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:19:40.835983 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-db6f5b97-d5ab-4644-94ca-72cf6ca35ee0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for user 3c719df3f54e442790c9a6c9d1e687e9 and project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'key_pairs'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:19:40.850077 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-db6f5b97-d5ab-4644-94ca-72cf6ca35ee0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.335496 Dec 18 03:19:40.850829 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 435/898] 10.222.0.24 () {60 vars in 1157 bytes} [Sat Dec 18 03:19:40 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:41.586377 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8b22d98d-e451-486a-90a7-8ce616cf366b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:41.587980 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8b22d98d-e451-486a-90a7-8ce616cf366b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] [instance: 83329381-8624-4e96-a968-8f2de6818b11] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:41.594299 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8b22d98d-e451-486a-90a7-8ce616cf366b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:41.594988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8b22d98d-e451-486a-90a7-8ce616cf366b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:41.595785 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8b22d98d-e451-486a-90a7-8ce616cf366b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:41.596225 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8b22d98d-e451-486a-90a7-8ce616cf366b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:41.610914 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-8b22d98d-e451-486a-90a7-8ce616cf366b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] HTTP exception thrown: Instance 83329381-8624-4e96-a968-8f2de6818b11 could not be found. Dec 18 03:19:41.611780 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8b22d98d-e451-486a-90a7-8ce616cf366b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Returning 404 to user: Instance 83329381-8624-4e96-a968-8f2de6818b11 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:19:41.612600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8b22d98d-e451-486a-90a7-8ce616cf366b tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11" status: 404 len: 111 microversion: 2.1 time: 0.030804 Dec 18 03:19:41.613309 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 464/899] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:41 2021] GET /compute/v2.1/servers/83329381-8624-4e96-a968-8f2de6818b11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:19:41.621981 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-be9a3b7e-2b5b-464f-a231-2ea8773ce14e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] Calling method '.version_select at 0x7fad261f45e0>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:41.640374 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-be9a3b7e-2b5b-464f-a231-2ea8773ce14e tempest-TestMinimumBasicScenario-747244964 tempest-TestMinimumBasicScenario-747244964-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-815539649" status: 202 len: 0 microversion: 2.1 time: 0.022490 Dec 18 03:19:41.644195 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 436/900] 10.222.0.24 () {58 vars in 1268 bytes} [Sat Dec 18 03:19:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-815539649 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:19:42.348577 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2024848188", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fda238b-cb83-4001-a89c-717f18485950"}], "security_groups": [{"name": "tempest-securitygroup--1696936819"}], "key_name": "tempest-keypair-2087650046", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:42.542779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.network.neutron [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] validate_networks() for [('3fda238b-cb83-4001-a89c-717f18485950', None, None, None, None, None)] {{(pid=116001) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:19:43.225742 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Flavor limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:19:43.226330 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Image limits 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:19:43.226673 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Flavor pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:19:43.227107 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Image pref 0:0:0 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:19:43.227515 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.virt.hardware [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:19:43.237553 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:43.238066 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:43.238894 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:43.239330 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:43.261651 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:19:43.265801 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for user 3c719df3f54e442790c9a6c9d1e687e9 and project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'ram', 'cores', 'instances'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:19:43.278665 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Going to run 1 instances... {{(pid=116001) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:19:43.281055 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:19:43.327876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4d970ea1-4148-4957-8f55-320179658a8a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.983276 Dec 18 03:19:43.333453 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 465/901] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:19:42 2021] POST /compute/v2.1/servers => generated 402 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:19:43.339753 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1d66b126-b17c-4c77-9549-7d4d6a2da3e7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:43.340970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1d66b126-b17c-4c77-9549-7d4d6a2da3e7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:43.410282 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1d66b126-b17c-4c77-9549-7d4d6a2da3e7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:43.420205 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1d66b126-b17c-4c77-9549-7d4d6a2da3e7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1238 microversion: 2.1 time: 0.084414 Dec 18 03:19:43.422341 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 437/902] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:43 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:44.438599 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-83928661-c917-459e-936e-d2a3fa3e8cf6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:44.439946 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-83928661-c917-459e-936e-d2a3fa3e8cf6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:44.451054 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-83928661-c917-459e-936e-d2a3fa3e8cf6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:44.451694 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-83928661-c917-459e-936e-d2a3fa3e8cf6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:44.452650 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-83928661-c917-459e-936e-d2a3fa3e8cf6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:44.453267 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-83928661-c917-459e-936e-d2a3fa3e8cf6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:44.713470 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-83928661-c917-459e-936e-d2a3fa3e8cf6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:44.736026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-83928661-c917-459e-936e-d2a3fa3e8cf6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1298 microversion: 2.1 time: 0.301539 Dec 18 03:19:44.736719 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 466/903] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:44 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1298 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:45.755083 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-658f67e6-c491-498c-be1a-d717e4caee71 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:45.755760 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-658f67e6-c491-498c-be1a-d717e4caee71 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:45.775884 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-658f67e6-c491-498c-be1a-d717e4caee71 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:45.776374 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-658f67e6-c491-498c-be1a-d717e4caee71 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:45.779718 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-658f67e6-c491-498c-be1a-d717e4caee71 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:45.780420 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-658f67e6-c491-498c-be1a-d717e4caee71 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:46.406757 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-658f67e6-c491-498c-be1a-d717e4caee71 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:46.417728 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-658f67e6-c491-498c-be1a-d717e4caee71 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1364 microversion: 2.1 time: 0.667309 Dec 18 03:19:46.418883 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 438/904] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:45 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1364 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:46.504370 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-ab19d5e8-c0b7-453e-9a22-961f30b5a0e6 req-dd0c26a4-0b73-4893-99ff-5ff3d1c3d17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d21616b-5525-492c-a7ac-85e63612742a", "tag": "1ec58379-1ff2-4be3-a202-e4a865f02b1a"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:46.505972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:46.505972 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:19:46.515714 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-ab19d5e8-c0b7-453e-9a22-961f30b5a0e6 req-dd0c26a4-0b73-4893-99ff-5ff3d1c3d17c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:46.516397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-ab19d5e8-c0b7-453e-9a22-961f30b5a0e6 req-dd0c26a4-0b73-4893-99ff-5ff3d1c3d17c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:46.528581 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-ab19d5e8-c0b7-453e-9a22-961f30b5a0e6 req-dd0c26a4-0b73-4893-99ff-5ff3d1c3d17c service nova] Creating event network-changed:1ec58379-1ff2-4be3-a202-e4a865f02b1a for instance 1d21616b-5525-492c-a7ac-85e63612742a on hv-cinder-81803 Dec 18 03:19:46.534839 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-ab19d5e8-c0b7-453e-9a22-961f30b5a0e6 req-dd0c26a4-0b73-4893-99ff-5ff3d1c3d17c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033921 Dec 18 03:19:46.535626 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 467/905] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:19:47.434986 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-17046350-5815-4b09-85f3-2e5442db61f6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:47.436340 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-17046350-5815-4b09-85f3-2e5442db61f6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:47.442885 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-17046350-5815-4b09-85f3-2e5442db61f6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:47.443402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-17046350-5815-4b09-85f3-2e5442db61f6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:47.444321 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-17046350-5815-4b09-85f3-2e5442db61f6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:47.444759 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-17046350-5815-4b09-85f3-2e5442db61f6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:47.684772 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-17046350-5815-4b09-85f3-2e5442db61f6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:47.692753 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-17046350-5815-4b09-85f3-2e5442db61f6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1364 microversion: 2.1 time: 0.262235 Dec 18 03:19:47.693882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 439/906] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:47 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:48.711403 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bed670c5-0415-4448-a278-3d2b2ca4abab tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:48.712377 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bed670c5-0415-4448-a278-3d2b2ca4abab tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:48.718571 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bed670c5-0415-4448-a278-3d2b2ca4abab tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:48.719015 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bed670c5-0415-4448-a278-3d2b2ca4abab tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:48.719789 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bed670c5-0415-4448-a278-3d2b2ca4abab tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:48.720219 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bed670c5-0415-4448-a278-3d2b2ca4abab tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:48.969355 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bed670c5-0415-4448-a278-3d2b2ca4abab tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:48.977172 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bed670c5-0415-4448-a278-3d2b2ca4abab tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1364 microversion: 2.1 time: 0.270207 Dec 18 03:19:48.977758 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 468/907] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:48 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:49.994945 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bb993f94-2eb4-4717-9f16-158158a699a3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:49.995823 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bb993f94-2eb4-4717-9f16-158158a699a3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:50.001348 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bb993f94-2eb4-4717-9f16-158158a699a3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:50.001876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bb993f94-2eb4-4717-9f16-158158a699a3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:50.002614 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bb993f94-2eb4-4717-9f16-158158a699a3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:50.003054 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bb993f94-2eb4-4717-9f16-158158a699a3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:50.148106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bb993f94-2eb4-4717-9f16-158158a699a3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:50.159081 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bb993f94-2eb4-4717-9f16-158158a699a3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1364 microversion: 2.1 time: 0.168347 Dec 18 03:19:50.159885 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 440/908] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:49 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:51.176100 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e935a37c-0b85-4c9e-b6f0-733325e27118 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:51.176824 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e935a37c-0b85-4c9e-b6f0-733325e27118 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:51.185858 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e935a37c-0b85-4c9e-b6f0-733325e27118 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:51.186441 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e935a37c-0b85-4c9e-b6f0-733325e27118 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:51.187311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e935a37c-0b85-4c9e-b6f0-733325e27118 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:51.187817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e935a37c-0b85-4c9e-b6f0-733325e27118 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:51.356899 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e935a37c-0b85-4c9e-b6f0-733325e27118 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:51.367490 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e935a37c-0b85-4c9e-b6f0-733325e27118 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1364 microversion: 2.1 time: 0.194988 Dec 18 03:19:51.368373 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 469/909] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:51 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:52.384082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5b7db2ef-c5ca-48bd-8994-f51e166052c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:52.384751 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5b7db2ef-c5ca-48bd-8994-f51e166052c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:52.391154 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b7db2ef-c5ca-48bd-8994-f51e166052c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:52.391597 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b7db2ef-c5ca-48bd-8994-f51e166052c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:52.392364 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b7db2ef-c5ca-48bd-8994-f51e166052c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:52.392792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5b7db2ef-c5ca-48bd-8994-f51e166052c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:52.519652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5b7db2ef-c5ca-48bd-8994-f51e166052c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:52.527335 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5b7db2ef-c5ca-48bd-8994-f51e166052c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1364 microversion: 2.1 time: 0.146919 Dec 18 03:19:52.527885 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 441/910] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:52 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:53.322987 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-d5f44d5b-8555-4f02-a810-fb8d8c2ca68e req-26a5d39d-2a7b-4e4e-9e6a-7f90c225e849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d21616b-5525-492c-a7ac-85e63612742a", "name": "network-vif-plugged", "status": "completed", "tag": "1ec58379-1ff2-4be3-a202-e4a865f02b1a"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:53.324617 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:53.324617 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:19:53.332063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-d5f44d5b-8555-4f02-a810-fb8d8c2ca68e req-26a5d39d-2a7b-4e4e-9e6a-7f90c225e849 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:53.332619 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-d5f44d5b-8555-4f02-a810-fb8d8c2ca68e req-26a5d39d-2a7b-4e4e-9e6a-7f90c225e849 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:53.344135 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-d5f44d5b-8555-4f02-a810-fb8d8c2ca68e req-26a5d39d-2a7b-4e4e-9e6a-7f90c225e849 service nova] Creating event network-vif-plugged:1ec58379-1ff2-4be3-a202-e4a865f02b1a for instance 1d21616b-5525-492c-a7ac-85e63612742a on hv-cinder-81803 Dec 18 03:19:53.348997 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-d5f44d5b-8555-4f02-a810-fb8d8c2ca68e req-26a5d39d-2a7b-4e4e-9e6a-7f90c225e849 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029697 Dec 18 03:19:53.349652 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 470/911] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:19:53.544175 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5130d813-2b53-4e09-a367-425cd9ce5768 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:53.544716 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5130d813-2b53-4e09-a367-425cd9ce5768 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:53.550906 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5130d813-2b53-4e09-a367-425cd9ce5768 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:53.551353 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5130d813-2b53-4e09-a367-425cd9ce5768 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:53.552128 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5130d813-2b53-4e09-a367-425cd9ce5768 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:53.552556 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5130d813-2b53-4e09-a367-425cd9ce5768 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:53.699447 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5130d813-2b53-4e09-a367-425cd9ce5768 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:53.706505 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5130d813-2b53-4e09-a367-425cd9ce5768 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1364 microversion: 2.1 time: 0.166340 Dec 18 03:19:53.707065 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 442/912] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:53 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:54.724332 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-9753f8b7-2a7e-40eb-8126-7f3623489bb4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:54.725021 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-9753f8b7-2a7e-40eb-8126-7f3623489bb4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:54.731575 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9753f8b7-2a7e-40eb-8126-7f3623489bb4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:54.732009 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9753f8b7-2a7e-40eb-8126-7f3623489bb4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:54.732772 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9753f8b7-2a7e-40eb-8126-7f3623489bb4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:54.733200 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-9753f8b7-2a7e-40eb-8126-7f3623489bb4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:54.872903 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-9753f8b7-2a7e-40eb-8126-7f3623489bb4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:54.880250 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-9753f8b7-2a7e-40eb-8126-7f3623489bb4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1364 microversion: 2.1 time: 0.160785 Dec 18 03:19:54.880826 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 471/913] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:54 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:19:55.895981 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-413e1ca4-424f-42a3-83e3-89e238d0cb77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:55.896584 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-413e1ca4-424f-42a3-83e3-89e238d0cb77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:55.903541 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-413e1ca4-424f-42a3-83e3-89e238d0cb77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:55.903979 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-413e1ca4-424f-42a3-83e3-89e238d0cb77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:55.904737 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-413e1ca4-424f-42a3-83e3-89e238d0cb77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:55.905163 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-413e1ca4-424f-42a3-83e3-89e238d0cb77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:56.034982 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-413e1ca4-424f-42a3-83e3-89e238d0cb77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:19:56.042287 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-413e1ca4-424f-42a3-83e3-89e238d0cb77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1550 microversion: 2.1 time: 0.149904 Dec 18 03:19:56.042841 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 443/914] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:19:55 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:19:56.058763 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e1858ae5-15b9-4c3f-ba22-b5e9360348ba tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:19:56.059281 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e1858ae5-15b9-4c3f-ba22-b5e9360348ba tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:56.065445 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1858ae5-15b9-4c3f-ba22-b5e9360348ba tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:56.065939 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1858ae5-15b9-4c3f-ba22-b5e9360348ba tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:56.066715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1858ae5-15b9-4c3f-ba22-b5e9360348ba tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:56.067149 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e1858ae5-15b9-4c3f-ba22-b5e9360348ba tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:56.147851 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e1858ae5-15b9-4c3f-ba22-b5e9360348ba tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093192 Dec 18 03:19:56.148375 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 472/915] 10.222.0.24 () {58 vars in 1274 bytes} [Sat Dec 18 03:19:56 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:19:57.293056 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6290c96b-49e2-4eec-a54f-ce29227c23a5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:57.294003 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6290c96b-49e2-4eec-a54f-ce29227c23a5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:57.297046 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-2d6636bb-ead2-4e2d-b4a1-c299ce602264 req-f22511f9-9ae8-4c9c-ae77-3490bd60de9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d21616b-5525-492c-a7ac-85e63612742a", "tag": "1ec58379-1ff2-4be3-a202-e4a865f02b1a"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:57.298891 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:19:57.298891 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:19:57.300675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6290c96b-49e2-4eec-a54f-ce29227c23a5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:57.301126 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6290c96b-49e2-4eec-a54f-ce29227c23a5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:57.301929 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6290c96b-49e2-4eec-a54f-ce29227c23a5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:57.302577 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6290c96b-49e2-4eec-a54f-ce29227c23a5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:57.307030 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-2d6636bb-ead2-4e2d-b4a1-c299ce602264 req-f22511f9-9ae8-4c9c-ae77-3490bd60de9d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:57.308328 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-2d6636bb-ead2-4e2d-b4a1-c299ce602264 req-f22511f9-9ae8-4c9c-ae77-3490bd60de9d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:57.320801 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-2d6636bb-ead2-4e2d-b4a1-c299ce602264 req-f22511f9-9ae8-4c9c-ae77-3490bd60de9d service nova] Creating event network-changed:1ec58379-1ff2-4be3-a202-e4a865f02b1a for instance 1d21616b-5525-492c-a7ac-85e63612742a on hv-cinder-81803 Dec 18 03:19:57.326533 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-2d6636bb-ead2-4e2d-b4a1-c299ce602264 req-f22511f9-9ae8-4c9c-ae77-3490bd60de9d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033720 Dec 18 03:19:57.327578 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 473/916] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:19:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:19:57.414082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6290c96b-49e2-4eec-a54f-ce29227c23a5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 14 microversion: 2.1 time: 0.125430 Dec 18 03:19:57.415017 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 444/917] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:19:57 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:19:58.426106 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b0ff51a5-907d-442c-a558-11dd2494503d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:58.427102 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b0ff51a5-907d-442c-a558-11dd2494503d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:58.433871 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0ff51a5-907d-442c-a558-11dd2494503d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:58.434321 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0ff51a5-907d-442c-a558-11dd2494503d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:58.435098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0ff51a5-907d-442c-a558-11dd2494503d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:58.435530 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b0ff51a5-907d-442c-a558-11dd2494503d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:58.517817 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b0ff51a5-907d-442c-a558-11dd2494503d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 14 microversion: 2.1 time: 0.096046 Dec 18 03:19:58.518424 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 474/918] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:19:58 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 03:19:59.529875 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d68f6cc6-4ef3-4185-b5ce-16b3033ab403 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:19:59.530909 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d68f6cc6-4ef3-4185-b5ce-16b3033ab403 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:19:59.538145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d68f6cc6-4ef3-4185-b5ce-16b3033ab403 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:59.538593 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d68f6cc6-4ef3-4185-b5ce-16b3033ab403 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:59.539546 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d68f6cc6-4ef3-4185-b5ce-16b3033ab403 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:19:59.540034 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d68f6cc6-4ef3-4185-b5ce-16b3033ab403 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:19:59.621970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d68f6cc6-4ef3-4185-b5ce-16b3033ab403 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 14 microversion: 2.1 time: 0.096611 Dec 18 03:19:59.624969 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 445/919] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:19:59 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:20:00.632804 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-eedbb857-892a-48cf-a515-0fc31b48bdb7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:00.633863 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-eedbb857-892a-48cf-a515-0fc31b48bdb7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:00.640706 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eedbb857-892a-48cf-a515-0fc31b48bdb7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:00.641154 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eedbb857-892a-48cf-a515-0fc31b48bdb7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:00.641956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eedbb857-892a-48cf-a515-0fc31b48bdb7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:00.642392 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-eedbb857-892a-48cf-a515-0fc31b48bdb7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:00.724719 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-eedbb857-892a-48cf-a515-0fc31b48bdb7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 14 microversion: 2.1 time: 0.095778 Dec 18 03:20:00.725331 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 475/920] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:00 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:20:01.737552 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-dc802208-c548-49e6-9f20-2666dc7a3603 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:01.738515 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-dc802208-c548-49e6-9f20-2666dc7a3603 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:01.746198 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dc802208-c548-49e6-9f20-2666dc7a3603 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:01.746639 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dc802208-c548-49e6-9f20-2666dc7a3603 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:01.747439 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dc802208-c548-49e6-9f20-2666dc7a3603 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:01.747866 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dc802208-c548-49e6-9f20-2666dc7a3603 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:01.844449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-dc802208-c548-49e6-9f20-2666dc7a3603 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 14 microversion: 2.1 time: 0.110907 Dec 18 03:20:01.845059 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 446/921] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:01 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:20:02.856190 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8ab9cd57-94e0-47ca-8517-9f884458cdf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:02.857221 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8ab9cd57-94e0-47ca-8517-9f884458cdf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:02.864370 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8ab9cd57-94e0-47ca-8517-9f884458cdf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:02.864816 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8ab9cd57-94e0-47ca-8517-9f884458cdf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:02.865586 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8ab9cd57-94e0-47ca-8517-9f884458cdf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:02.866040 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8ab9cd57-94e0-47ca-8517-9f884458cdf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:02.950179 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8ab9cd57-94e0-47ca-8517-9f884458cdf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 14 microversion: 2.1 time: 0.098225 Dec 18 03:20:02.950786 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 476/922] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:02 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:20:03.960859 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-02d7c7ea-21d1-4f5a-b803-76ad28504e36 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:03.961930 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-02d7c7ea-21d1-4f5a-b803-76ad28504e36 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:03.969346 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-02d7c7ea-21d1-4f5a-b803-76ad28504e36 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:03.969824 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-02d7c7ea-21d1-4f5a-b803-76ad28504e36 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:03.970595 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-02d7c7ea-21d1-4f5a-b803-76ad28504e36 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:03.971026 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-02d7c7ea-21d1-4f5a-b803-76ad28504e36 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:04.056803 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-02d7c7ea-21d1-4f5a-b803-76ad28504e36 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 14 microversion: 2.1 time: 0.099778 Dec 18 03:20:04.057421 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 447/923] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:03 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:20:05.067987 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-639cf58a-8d46-4616-967e-e10c929a19a8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:05.068978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-639cf58a-8d46-4616-967e-e10c929a19a8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:05.076562 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-639cf58a-8d46-4616-967e-e10c929a19a8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:05.077004 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-639cf58a-8d46-4616-967e-e10c929a19a8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:05.077807 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-639cf58a-8d46-4616-967e-e10c929a19a8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:05.078232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-639cf58a-8d46-4616-967e-e10c929a19a8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:05.163086 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-639cf58a-8d46-4616-967e-e10c929a19a8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 14 microversion: 2.1 time: 0.098959 Dec 18 03:20:05.163718 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 477/924] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:05 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:20:06.174611 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2182b475-7207-4c83-9a75-ed4439ae44da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:06.175668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2182b475-7207-4c83-9a75-ed4439ae44da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:06.183120 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2182b475-7207-4c83-9a75-ed4439ae44da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:06.183642 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2182b475-7207-4c83-9a75-ed4439ae44da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:06.184561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2182b475-7207-4c83-9a75-ed4439ae44da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:06.184993 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2182b475-7207-4c83-9a75-ed4439ae44da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:06.266848 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2182b475-7207-4c83-9a75-ed4439ae44da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 14 microversion: 2.1 time: 0.096273 Dec 18 03:20:06.267454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 448/925] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:06 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:20:07.278150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d5888f55-29b2-49d9-829f-396328e74019 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:07.279146 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d5888f55-29b2-49d9-829f-396328e74019 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:07.286023 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d5888f55-29b2-49d9-829f-396328e74019 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:07.286467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d5888f55-29b2-49d9-829f-396328e74019 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:07.287236 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d5888f55-29b2-49d9-829f-396328e74019 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:07.287666 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d5888f55-29b2-49d9-829f-396328e74019 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:07.387861 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d5888f55-29b2-49d9-829f-396328e74019 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 7599 microversion: 2.1 time: 0.112567 Dec 18 03:20:07.388657 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 478/926] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:07 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 7599 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:08.399560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7ca21923-da66-42aa-9219-e0f4903975bd tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:08.401384 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7ca21923-da66-42aa-9219-e0f4903975bd tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:08.408338 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7ca21923-da66-42aa-9219-e0f4903975bd tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:08.408789 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7ca21923-da66-42aa-9219-e0f4903975bd tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:08.409568 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7ca21923-da66-42aa-9219-e0f4903975bd tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:08.410024 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7ca21923-da66-42aa-9219-e0f4903975bd tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:08.504082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7ca21923-da66-42aa-9219-e0f4903975bd tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 16123 microversion: 2.1 time: 0.108366 Dec 18 03:20:08.504716 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 449/927] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:08 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 16123 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:09.515838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8a61e9b7-c4e0-4cc7-8c48-c4083cea30cb tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:09.516831 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8a61e9b7-c4e0-4cc7-8c48-c4083cea30cb tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:09.523975 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8a61e9b7-c4e0-4cc7-8c48-c4083cea30cb tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:09.524419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8a61e9b7-c4e0-4cc7-8c48-c4083cea30cb tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:09.525715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8a61e9b7-c4e0-4cc7-8c48-c4083cea30cb tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:09.526145 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8a61e9b7-c4e0-4cc7-8c48-c4083cea30cb tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:09.619605 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8a61e9b7-c4e0-4cc7-8c48-c4083cea30cb tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 18356 microversion: 2.1 time: 0.107716 Dec 18 03:20:09.620232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 479/928] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:09 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 18356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:10.631441 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-48888699-92ec-48ac-a370-5e5b92aee860 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:10.632438 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-48888699-92ec-48ac-a370-5e5b92aee860 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:10.639763 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-48888699-92ec-48ac-a370-5e5b92aee860 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:10.640206 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-48888699-92ec-48ac-a370-5e5b92aee860 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:10.640978 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-48888699-92ec-48ac-a370-5e5b92aee860 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:10.641402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-48888699-92ec-48ac-a370-5e5b92aee860 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:10.735438 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-48888699-92ec-48ac-a370-5e5b92aee860 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 20997 microversion: 2.1 time: 0.107802 Dec 18 03:20:10.736147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 450/929] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:10 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 20997 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:11.747533 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c4783e8a-4d38-4e3b-8459-c981a71ffd50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:11.748443 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c4783e8a-4d38-4e3b-8459-c981a71ffd50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:11.755319 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c4783e8a-4d38-4e3b-8459-c981a71ffd50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:11.755762 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c4783e8a-4d38-4e3b-8459-c981a71ffd50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:11.756560 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c4783e8a-4d38-4e3b-8459-c981a71ffd50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:11.756989 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c4783e8a-4d38-4e3b-8459-c981a71ffd50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:11.855566 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c4783e8a-4d38-4e3b-8459-c981a71ffd50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 22996 microversion: 2.1 time: 0.111881 Dec 18 03:20:11.856184 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 480/930] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:11 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 22996 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:12.867972 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c72fd256-eb3e-4e4c-a101-2d177f8822da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:12.869633 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c72fd256-eb3e-4e4c-a101-2d177f8822da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:12.876385 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c72fd256-eb3e-4e4c-a101-2d177f8822da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:12.876828 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c72fd256-eb3e-4e4c-a101-2d177f8822da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:12.877591 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c72fd256-eb3e-4e4c-a101-2d177f8822da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:12.878051 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c72fd256-eb3e-4e4c-a101-2d177f8822da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:12.968846 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c72fd256-eb3e-4e4c-a101-2d177f8822da tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 24416 microversion: 2.1 time: 0.104772 Dec 18 03:20:12.969503 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 451/931] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:12 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 24416 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:13.981184 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-933c7533-50a3-4086-be00-62e04b6617ac tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:13.982234 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-933c7533-50a3-4086-be00-62e04b6617ac tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:13.989001 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-933c7533-50a3-4086-be00-62e04b6617ac tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:13.989446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-933c7533-50a3-4086-be00-62e04b6617ac tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:13.990297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-933c7533-50a3-4086-be00-62e04b6617ac tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:13.990733 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-933c7533-50a3-4086-be00-62e04b6617ac tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:14.080625 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-933c7533-50a3-4086-be00-62e04b6617ac tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 26095 microversion: 2.1 time: 0.103728 Dec 18 03:20:14.081234 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 481/932] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:13 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 26095 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:20:15.093453 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ca319072-a180-4c99-b8a6-37b95b091ab1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:15.094487 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ca319072-a180-4c99-b8a6-37b95b091ab1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:15.102271 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ca319072-a180-4c99-b8a6-37b95b091ab1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:15.103440 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ca319072-a180-4c99-b8a6-37b95b091ab1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:15.104235 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ca319072-a180-4c99-b8a6-37b95b091ab1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:15.104675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ca319072-a180-4c99-b8a6-37b95b091ab1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:15.209290 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ca319072-a180-4c99-b8a6-37b95b091ab1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 27378 microversion: 2.1 time: 0.119678 Dec 18 03:20:15.210049 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 452/933] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:15 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 27378 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:16.222587 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8700b3ee-48a7-4804-99fd-73ed3ee864f5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:16.223626 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8700b3ee-48a7-4804-99fd-73ed3ee864f5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:16.230875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8700b3ee-48a7-4804-99fd-73ed3ee864f5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:16.231315 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8700b3ee-48a7-4804-99fd-73ed3ee864f5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:16.232079 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8700b3ee-48a7-4804-99fd-73ed3ee864f5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:16.232505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8700b3ee-48a7-4804-99fd-73ed3ee864f5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:16.326237 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8700b3ee-48a7-4804-99fd-73ed3ee864f5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 28034 microversion: 2.1 time: 0.107728 Dec 18 03:20:16.326866 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 482/934] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:16 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 28034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:17.338655 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2c4af48f-d012-4779-b249-a38e749687c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:17.339661 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2c4af48f-d012-4779-b249-a38e749687c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:17.346518 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2c4af48f-d012-4779-b249-a38e749687c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:17.346966 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2c4af48f-d012-4779-b249-a38e749687c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:17.347735 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2c4af48f-d012-4779-b249-a38e749687c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:17.348167 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2c4af48f-d012-4779-b249-a38e749687c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:17.440483 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2c4af48f-d012-4779-b249-a38e749687c9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 28218 microversion: 2.1 time: 0.106205 Dec 18 03:20:17.441149 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 453/935] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:17 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 28218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:18.453132 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-85323778-574f-40ae-8ca2-220f49691afc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:18.454155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-85323778-574f-40ae-8ca2-220f49691afc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:18.460902 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-85323778-574f-40ae-8ca2-220f49691afc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:18.461349 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-85323778-574f-40ae-8ca2-220f49691afc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:18.462786 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-85323778-574f-40ae-8ca2-220f49691afc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:18.463239 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-85323778-574f-40ae-8ca2-220f49691afc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:18.552739 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-85323778-574f-40ae-8ca2-220f49691afc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 28218 microversion: 2.1 time: 0.103615 Dec 18 03:20:18.554047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 483/936] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:18 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 28218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:20:19.564796 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-8bd671c7-9cdd-433a-b313-0b392c284d19 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:19.565812 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-8bd671c7-9cdd-433a-b313-0b392c284d19 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:19.572594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8bd671c7-9cdd-433a-b313-0b392c284d19 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:19.573031 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8bd671c7-9cdd-433a-b313-0b392c284d19 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:19.573819 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8bd671c7-9cdd-433a-b313-0b392c284d19 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:19.574245 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-8bd671c7-9cdd-433a-b313-0b392c284d19 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:21.672805 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-8bd671c7-9cdd-433a-b313-0b392c284d19 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 28508 microversion: 2.1 time: 2.111747 Dec 18 03:20:21.673404 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 454/937] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:19 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 28508 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:22.685201 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1c953837-501e-4319-80d5-dd56986e35e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:22.686231 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1c953837-501e-4319-80d5-dd56986e35e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:22.693095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c953837-501e-4319-80d5-dd56986e35e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:22.693550 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c953837-501e-4319-80d5-dd56986e35e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:22.694348 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c953837-501e-4319-80d5-dd56986e35e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:22.694779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1c953837-501e-4319-80d5-dd56986e35e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:22.786786 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1c953837-501e-4319-80d5-dd56986e35e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 28676 microversion: 2.1 time: 0.105975 Dec 18 03:20:22.789494 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 484/938] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:22 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 28676 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:23.798928 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3cdbd931-3a7a-4763-932a-513d57de9945 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:23.799847 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3cdbd931-3a7a-4763-932a-513d57de9945 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:23.807486 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cdbd931-3a7a-4763-932a-513d57de9945 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:23.807942 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cdbd931-3a7a-4763-932a-513d57de9945 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:23.808722 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cdbd931-3a7a-4763-932a-513d57de9945 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:23.809160 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cdbd931-3a7a-4763-932a-513d57de9945 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:23.894588 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3cdbd931-3a7a-4763-932a-513d57de9945 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 28676 microversion: 2.1 time: 0.099633 Dec 18 03:20:23.895460 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 455/939] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:23 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 28676 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:24.907296 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-65152b48-12b5-4024-96c1-5b5b1018282d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:24.908361 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-65152b48-12b5-4024-96c1-5b5b1018282d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:24.915338 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65152b48-12b5-4024-96c1-5b5b1018282d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:24.915790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65152b48-12b5-4024-96c1-5b5b1018282d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:24.917316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65152b48-12b5-4024-96c1-5b5b1018282d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:24.917812 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65152b48-12b5-4024-96c1-5b5b1018282d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:25.077108 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-65152b48-12b5-4024-96c1-5b5b1018282d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 28676 microversion: 2.1 time: 0.173602 Dec 18 03:20:25.078090 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 485/940] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:24 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 28676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:25.297429 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-402706203", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-412012440", "security_groups": [{"name": "tempest-secgroup-smoke-228218707"}], "block_device_mapping_v2": [{"uuid": "4d0d7193-0843-41d7-9826-fe884df21b9c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "564be5c6-0032-4b6f-a63b-8fc0ef0d3621"}]}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:25.410442 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] validate_networks() for [('564be5c6-0032-4b6f-a63b-8fc0ef0d3621', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:20:25.760541 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:20:25.760967 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:20:25.761436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:20:25.761933 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:20:25.762394 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:20:25.770998 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:25.771448 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:25.772265 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:25.772703 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:25.789178 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for project f7f34416462043419f27fc97d17ab2bb. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:20:25.793684 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Getting quotas for user fd2d51b351b44cdfb136d754ffdf3f0f and project f7f34416462043419f27fc97d17ab2bb. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:20:25.847610 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:20:25.849913 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d0d7193-0843-41d7-9826-fe884df21b9c',volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:20:25.969213 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [cf9535fc-b301-4399-a245-9f11e0b5b808] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 18 03:20:26.089936 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f30951df-61e6-494a-94d8-293fef07f227 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:26.090957 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f30951df-61e6-494a-94d8-293fef07f227 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:26.097882 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f30951df-61e6-494a-94d8-293fef07f227 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:26.098371 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f30951df-61e6-494a-94d8-293fef07f227 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:26.099272 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f30951df-61e6-494a-94d8-293fef07f227 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:26.099775 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f30951df-61e6-494a-94d8-293fef07f227 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:26.188603 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f30951df-61e6-494a-94d8-293fef07f227 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 28676 microversion: 2.1 time: 0.103156 Dec 18 03:20:26.189226 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 486/941] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:26 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 28676 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:20:26.985826 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [cf9535fc-b301-4399-a245-9f11e0b5b808] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 53532. Dec 18 03:20:26.990006 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3c043b14-694b-4f8f-b767-b3d7df7e64e1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.696641 Dec 18 03:20:26.990707 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 456/942] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:20:25 2021] POST /compute/v2.1/servers => generated 405 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 18 03:20:27.001161 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6d15703b-05b8-4064-83b2-830d114fe390 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:27.001901 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6d15703b-05b8-4064-83b2-830d114fe390 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:27.056362 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6d15703b-05b8-4064-83b2-830d114fe390 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:27.063108 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6d15703b-05b8-4064-83b2-830d114fe390 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1093 microversion: 2.1 time: 0.065932 Dec 18 03:20:27.063680 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 487/943] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:26 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:27.200821 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b9c0eae7-133a-44f5-8b50-1b573b220a50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:27.201856 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b9c0eae7-133a-44f5-8b50-1b573b220a50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:27.208095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b9c0eae7-133a-44f5-8b50-1b573b220a50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:27.208668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b9c0eae7-133a-44f5-8b50-1b573b220a50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:27.209434 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b9c0eae7-133a-44f5-8b50-1b573b220a50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:27.209905 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b9c0eae7-133a-44f5-8b50-1b573b220a50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:27.301774 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b9c0eae7-133a-44f5-8b50-1b573b220a50 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 29628 microversion: 2.1 time: 0.105084 Dec 18 03:20:27.302561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 457/944] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:27 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 29628 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:28.079491 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bb2bd46c-0d66-466e-ad57-11eee6ed0e3a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:28.080104 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bb2bd46c-0d66-466e-ad57-11eee6ed0e3a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:28.086627 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb2bd46c-0d66-466e-ad57-11eee6ed0e3a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:28.087078 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb2bd46c-0d66-466e-ad57-11eee6ed0e3a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:28.087857 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb2bd46c-0d66-466e-ad57-11eee6ed0e3a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:28.088292 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bb2bd46c-0d66-466e-ad57-11eee6ed0e3a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:28.147456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bb2bd46c-0d66-466e-ad57-11eee6ed0e3a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:28.155814 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bb2bd46c-0d66-466e-ad57-11eee6ed0e3a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1135 microversion: 2.1 time: 0.080009 Dec 18 03:20:28.156381 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 488/945] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:28 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1135 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:28.314662 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6c6261a0-d46a-4fce-a43f-4dde776d2f8d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:28.315681 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6c6261a0-d46a-4fce-a43f-4dde776d2f8d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:28.323986 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6c6261a0-d46a-4fce-a43f-4dde776d2f8d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:28.324432 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6c6261a0-d46a-4fce-a43f-4dde776d2f8d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:28.325209 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6c6261a0-d46a-4fce-a43f-4dde776d2f8d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:28.325665 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6c6261a0-d46a-4fce-a43f-4dde776d2f8d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:28.427034 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6c6261a0-d46a-4fce-a43f-4dde776d2f8d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 31587 microversion: 2.1 time: 0.116177 Dec 18 03:20:28.427687 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 458/946] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:28 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 31587 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:29.172397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ffbfa20d-5062-42b9-804b-9c18515572fd tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:29.173124 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ffbfa20d-5062-42b9-804b-9c18515572fd tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:29.179525 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ffbfa20d-5062-42b9-804b-9c18515572fd tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:29.180033 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ffbfa20d-5062-42b9-804b-9c18515572fd tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:29.180811 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ffbfa20d-5062-42b9-804b-9c18515572fd tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:29.181243 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ffbfa20d-5062-42b9-804b-9c18515572fd tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:29.241602 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ffbfa20d-5062-42b9-804b-9c18515572fd tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:29.249771 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ffbfa20d-5062-42b9-804b-9c18515572fd tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1209 microversion: 2.1 time: 0.080972 Dec 18 03:20:29.250534 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 489/947] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:29 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:29.440257 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-105c2104-0039-41d9-beb5-ed0c56b0a537 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:29.441277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-105c2104-0039-41d9-beb5-ed0c56b0a537 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:29.448659 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-105c2104-0039-41d9-beb5-ed0c56b0a537 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:29.449106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-105c2104-0039-41d9-beb5-ed0c56b0a537 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:29.449930 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-105c2104-0039-41d9-beb5-ed0c56b0a537 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:29.450369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-105c2104-0039-41d9-beb5-ed0c56b0a537 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:29.550208 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-105c2104-0039-41d9-beb5-ed0c56b0a537 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 33187 microversion: 2.1 time: 0.114113 Dec 18 03:20:29.550970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 459/948] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:29 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 33187 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:20:30.199640 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-31f02b8c-654a-47fd-95b0-861f242cbc3b req-62e88b2c-9657-40a8-8db9-023224342efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b643a05-8259-4a3b-a274-23652c18a879", "tag": "bc34ae5c-b28d-4f84-bfcf-c60e402449ba"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:30.204219 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:20:30.204219 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:20:30.215491 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-31f02b8c-654a-47fd-95b0-861f242cbc3b req-62e88b2c-9657-40a8-8db9-023224342efa service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:30.216029 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-31f02b8c-654a-47fd-95b0-861f242cbc3b req-62e88b2c-9657-40a8-8db9-023224342efa service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:30.229381 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-31f02b8c-654a-47fd-95b0-861f242cbc3b req-62e88b2c-9657-40a8-8db9-023224342efa service nova] Creating event network-changed:bc34ae5c-b28d-4f84-bfcf-c60e402449ba for instance 4b643a05-8259-4a3b-a274-23652c18a879 on hv-cinder-81803 Dec 18 03:20:30.238001 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-31f02b8c-654a-47fd-95b0-861f242cbc3b req-62e88b2c-9657-40a8-8db9-023224342efa service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050812 Dec 18 03:20:30.238975 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 490/949] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:20:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:20:30.266987 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3fdd276b-72b5-409f-a7c4-07ab68409f23 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:30.268223 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3fdd276b-72b5-409f-a7c4-07ab68409f23 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:30.278284 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3fdd276b-72b5-409f-a7c4-07ab68409f23 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:30.278748 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3fdd276b-72b5-409f-a7c4-07ab68409f23 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:30.279739 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3fdd276b-72b5-409f-a7c4-07ab68409f23 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:30.280186 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3fdd276b-72b5-409f-a7c4-07ab68409f23 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:30.530974 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3fdd276b-72b5-409f-a7c4-07ab68409f23 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:30.538860 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3fdd276b-72b5-409f-a7c4-07ab68409f23 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.276009 Dec 18 03:20:30.539441 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 460/950] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:30 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:30.563109 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3674838d-8535-401d-b3c3-7f9e2cfd3211 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:30.564209 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3674838d-8535-401d-b3c3-7f9e2cfd3211 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:30.570378 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3674838d-8535-401d-b3c3-7f9e2cfd3211 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:30.570903 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3674838d-8535-401d-b3c3-7f9e2cfd3211 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:30.571784 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3674838d-8535-401d-b3c3-7f9e2cfd3211 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:30.572224 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3674838d-8535-401d-b3c3-7f9e2cfd3211 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:30.662278 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3674838d-8535-401d-b3c3-7f9e2cfd3211 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 34090 microversion: 2.1 time: 0.102978 Dec 18 03:20:30.662923 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 491/951] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:30 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 34090 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:20:31.555671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-22b3b257-ceee-4a3f-86a7-56a43faee260 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:31.556174 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-22b3b257-ceee-4a3f-86a7-56a43faee260 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:31.563153 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22b3b257-ceee-4a3f-86a7-56a43faee260 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:31.563603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22b3b257-ceee-4a3f-86a7-56a43faee260 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:31.564392 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22b3b257-ceee-4a3f-86a7-56a43faee260 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:31.564823 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-22b3b257-ceee-4a3f-86a7-56a43faee260 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:31.674596 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1546a808-0f0c-48bb-abb2-537cfb89422c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:31.675596 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1546a808-0f0c-48bb-abb2-537cfb89422c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:31.683153 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1546a808-0f0c-48bb-abb2-537cfb89422c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:31.683602 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1546a808-0f0c-48bb-abb2-537cfb89422c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:31.684380 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1546a808-0f0c-48bb-abb2-537cfb89422c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:31.684812 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1546a808-0f0c-48bb-abb2-537cfb89422c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:31.697946 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-22b3b257-ceee-4a3f-86a7-56a43faee260 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:31.705484 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-22b3b257-ceee-4a3f-86a7-56a43faee260 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.153574 Dec 18 03:20:31.706191 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 461/952] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:31 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:31.782757 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1546a808-0f0c-48bb-abb2-537cfb89422c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 35017 microversion: 2.1 time: 0.112048 Dec 18 03:20:31.783387 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 492/953] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:31 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 35017 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:20:32.722188 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-60a41cbf-9473-42b2-b364-eaf0a8ae6c6d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:32.722795 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-60a41cbf-9473-42b2-b364-eaf0a8ae6c6d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:32.729778 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-60a41cbf-9473-42b2-b364-eaf0a8ae6c6d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:32.730493 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-60a41cbf-9473-42b2-b364-eaf0a8ae6c6d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:32.731240 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-60a41cbf-9473-42b2-b364-eaf0a8ae6c6d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:32.731667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-60a41cbf-9473-42b2-b364-eaf0a8ae6c6d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:32.795674 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-da088bc4-adde-4934-8da2-058ce9df2823 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:32.796776 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-da088bc4-adde-4934-8da2-058ce9df2823 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:32.803683 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da088bc4-adde-4934-8da2-058ce9df2823 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:32.804129 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da088bc4-adde-4934-8da2-058ce9df2823 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:32.804906 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da088bc4-adde-4934-8da2-058ce9df2823 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:32.805337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-da088bc4-adde-4934-8da2-058ce9df2823 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:32.860312 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-60a41cbf-9473-42b2-b364-eaf0a8ae6c6d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:32.867933 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-60a41cbf-9473-42b2-b364-eaf0a8ae6c6d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.149375 Dec 18 03:20:32.868533 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 462/954] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:32 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:32.894081 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-da088bc4-adde-4934-8da2-058ce9df2823 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 36533 microversion: 2.1 time: 0.102895 Dec 18 03:20:32.894717 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 493/955] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:32 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 36533 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:20:33.884318 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d1e6b347-ee02-4ea7-b5e4-5dfcf04e971d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:33.884975 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d1e6b347-ee02-4ea7-b5e4-5dfcf04e971d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:33.891386 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d1e6b347-ee02-4ea7-b5e4-5dfcf04e971d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:33.891827 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d1e6b347-ee02-4ea7-b5e4-5dfcf04e971d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:33.892589 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d1e6b347-ee02-4ea7-b5e4-5dfcf04e971d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:33.893011 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d1e6b347-ee02-4ea7-b5e4-5dfcf04e971d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:33.906290 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-246ceb1f-5bf9-4520-8e5e-9b1f06c49f28 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:33.907317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-246ceb1f-5bf9-4520-8e5e-9b1f06c49f28 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:33.914329 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-246ceb1f-5bf9-4520-8e5e-9b1f06c49f28 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:33.914810 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-246ceb1f-5bf9-4520-8e5e-9b1f06c49f28 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:33.915625 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-246ceb1f-5bf9-4520-8e5e-9b1f06c49f28 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:33.916060 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-246ceb1f-5bf9-4520-8e5e-9b1f06c49f28 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:34.011182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-246ceb1f-5bf9-4520-8e5e-9b1f06c49f28 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 38105 microversion: 2.1 time: 0.108826 Dec 18 03:20:34.011831 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 494/956] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:33 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 38105 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:34.026836 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d1e6b347-ee02-4ea7-b5e4-5dfcf04e971d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:34.034009 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d1e6b347-ee02-4ea7-b5e4-5dfcf04e971d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.153293 Dec 18 03:20:34.034566 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 463/957] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:33 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:35.022847 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bc2eb79a-f488-452d-a350-bac685f99f2f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:35.023877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bc2eb79a-f488-452d-a350-bac685f99f2f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:35.030935 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bc2eb79a-f488-452d-a350-bac685f99f2f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:35.031382 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bc2eb79a-f488-452d-a350-bac685f99f2f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:35.032156 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bc2eb79a-f488-452d-a350-bac685f99f2f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:35.032598 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bc2eb79a-f488-452d-a350-bac685f99f2f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:35.050964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-944afab8-d2fa-4878-b226-78ad6c4c5336 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:35.051580 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-944afab8-d2fa-4878-b226-78ad6c4c5336 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:35.057902 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-944afab8-d2fa-4878-b226-78ad6c4c5336 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:35.058916 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-944afab8-d2fa-4878-b226-78ad6c4c5336 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:35.059967 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-944afab8-d2fa-4878-b226-78ad6c4c5336 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:35.060468 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-944afab8-d2fa-4878-b226-78ad6c4c5336 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:35.126882 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bc2eb79a-f488-452d-a350-bac685f99f2f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 38211 microversion: 2.1 time: 0.107863 Dec 18 03:20:35.127529 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 495/958] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:35 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 38211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:35.192296 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-944afab8-d2fa-4878-b226-78ad6c4c5336 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:35.200152 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-944afab8-d2fa-4878-b226-78ad6c4c5336 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.152799 Dec 18 03:20:35.200708 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 464/959] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:35 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:20:36.139082 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d5baa1ff-a331-4d1f-96ee-0058a65d054d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:36.140106 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d5baa1ff-a331-4d1f-96ee-0058a65d054d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:36.147024 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d5baa1ff-a331-4d1f-96ee-0058a65d054d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:36.147465 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d5baa1ff-a331-4d1f-96ee-0058a65d054d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:36.148240 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d5baa1ff-a331-4d1f-96ee-0058a65d054d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:36.148670 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d5baa1ff-a331-4d1f-96ee-0058a65d054d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:36.216912 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b1712b63-ef9c-4a7e-a094-a0c2508300c1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:36.217524 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b1712b63-ef9c-4a7e-a094-a0c2508300c1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:36.223960 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b1712b63-ef9c-4a7e-a094-a0c2508300c1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:36.224345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b1712b63-ef9c-4a7e-a094-a0c2508300c1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:36.225123 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b1712b63-ef9c-4a7e-a094-a0c2508300c1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:36.225563 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b1712b63-ef9c-4a7e-a094-a0c2508300c1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:36.240360 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d5baa1ff-a331-4d1f-96ee-0058a65d054d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 38211 microversion: 2.1 time: 0.106076 Dec 18 03:20:36.241264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 496/960] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:36 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 38211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:36.355268 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b1712b63-ef9c-4a7e-a094-a0c2508300c1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:36.362559 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b1712b63-ef9c-4a7e-a094-a0c2508300c1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.150202 Dec 18 03:20:36.363112 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 465/961] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:36 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:20:37.253285 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-10c45d1c-9c68-46ff-9291-ce25ade2ee3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:37.254344 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-10c45d1c-9c68-46ff-9291-ce25ade2ee3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:37.261213 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-10c45d1c-9c68-46ff-9291-ce25ade2ee3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:37.262292 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-10c45d1c-9c68-46ff-9291-ce25ade2ee3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:37.263063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-10c45d1c-9c68-46ff-9291-ce25ade2ee3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:37.263493 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-10c45d1c-9c68-46ff-9291-ce25ade2ee3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:37.350839 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-10c45d1c-9c68-46ff-9291-ce25ade2ee3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 38211 microversion: 2.1 time: 0.101499 Dec 18 03:20:37.351454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 497/962] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:37 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 38211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:37.378957 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5404a292-1a0e-44d5-bf54-2af5449dd869 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:37.379574 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5404a292-1a0e-44d5-bf54-2af5449dd869 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:37.385891 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5404a292-1a0e-44d5-bf54-2af5449dd869 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:37.386927 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5404a292-1a0e-44d5-bf54-2af5449dd869 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:37.387723 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5404a292-1a0e-44d5-bf54-2af5449dd869 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:37.388156 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5404a292-1a0e-44d5-bf54-2af5449dd869 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:37.524516 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-5404a292-1a0e-44d5-bf54-2af5449dd869 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:37.532067 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5404a292-1a0e-44d5-bf54-2af5449dd869 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.156772 Dec 18 03:20:37.532753 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 466/963] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:37 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:38.363296 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ca96ecaa-a145-4982-ae1e-b6280f355410 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:38.364328 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ca96ecaa-a145-4982-ae1e-b6280f355410 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:38.371343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ca96ecaa-a145-4982-ae1e-b6280f355410 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:38.371786 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ca96ecaa-a145-4982-ae1e-b6280f355410 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:38.372563 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ca96ecaa-a145-4982-ae1e-b6280f355410 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:38.372993 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ca96ecaa-a145-4982-ae1e-b6280f355410 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:38.462610 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ca96ecaa-a145-4982-ae1e-b6280f355410 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 200 len: 38342 microversion: 2.1 time: 0.103148 Dec 18 03:20:38.463254 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 498/964] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:38 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 38342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:20:38.473524 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-60f6818a-b416-4645-a43b-8fc37f6c81fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:38.474116 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-60f6818a-b416-4645-a43b-8fc37f6c81fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:38.481130 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-60f6818a-b416-4645-a43b-8fc37f6c81fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:38.481566 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-60f6818a-b416-4645-a43b-8fc37f6c81fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:38.482363 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-60f6818a-b416-4645-a43b-8fc37f6c81fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:38.482789 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-60f6818a-b416-4645-a43b-8fc37f6c81fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:38.505880 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-60f6818a-b416-4645-a43b-8fc37f6c81fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/ips" status: 200 len: 145 microversion: 2.1 time: 0.035886 Dec 18 03:20:38.506431 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 467/965] 10.222.0.24 () {58 vars in 1247 bytes} [Sat Dec 18 03:20:38 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:20:38.549102 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-45276cd6-ae99-4c27-a10c-88120914c740 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:38.549832 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-45276cd6-ae99-4c27-a10c-88120914c740 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:38.556812 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-45276cd6-ae99-4c27-a10c-88120914c740 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:38.557317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-45276cd6-ae99-4c27-a10c-88120914c740 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:38.558129 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-45276cd6-ae99-4c27-a10c-88120914c740 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:38.559501 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-45276cd6-ae99-4c27-a10c-88120914c740 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:38.689264 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-45276cd6-ae99-4c27-a10c-88120914c740 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:38.697013 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-45276cd6-ae99-4c27-a10c-88120914c740 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.152041 Dec 18 03:20:38.697571 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 499/966] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:38 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:39.713240 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ef831cec-fb72-4c8c-9171-cccdcd389538 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:39.713884 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ef831cec-fb72-4c8c-9171-cccdcd389538 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:39.720631 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ef831cec-fb72-4c8c-9171-cccdcd389538 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:39.721148 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ef831cec-fb72-4c8c-9171-cccdcd389538 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:39.721964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ef831cec-fb72-4c8c-9171-cccdcd389538 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:39.722397 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ef831cec-fb72-4c8c-9171-cccdcd389538 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:39.854225 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ef831cec-fb72-4c8c-9171-cccdcd389538 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:39.862849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ef831cec-fb72-4c8c-9171-cccdcd389538 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.153254 Dec 18 03:20:39.863425 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 468/967] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:39 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:40.685215 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-18c9922e-0efa-4472-a161-775ea25d0a87 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21cb29aa-650b-4c29-80e2-e0677f55ba9f"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:40.686327 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-18c9922e-0efa-4472-a161-775ea25d0a87 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:40.692541 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18c9922e-0efa-4472-a161-775ea25d0a87 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:40.692984 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18c9922e-0efa-4472-a161-775ea25d0a87 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:40.693797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18c9922e-0efa-4472-a161-775ea25d0a87 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:40.694228 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-18c9922e-0efa-4472-a161-775ea25d0a87 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:40.880433 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7b5af046-8f4e-4c9d-8482-7d781538007a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:40.881045 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7b5af046-8f4e-4c9d-8482-7d781538007a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:40.888330 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7b5af046-8f4e-4c9d-8482-7d781538007a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:40.888767 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7b5af046-8f4e-4c9d-8482-7d781538007a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:40.889574 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7b5af046-8f4e-4c9d-8482-7d781538007a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:40.890116 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7b5af046-8f4e-4c9d-8482-7d781538007a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:40.939949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-18c9922e-0efa-4472-a161-775ea25d0a87 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258125 Dec 18 03:20:40.940668 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 500/968] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:20:40 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:20:41.034675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7b5af046-8f4e-4c9d-8482-7d781538007a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:41.042335 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7b5af046-8f4e-4c9d-8482-7d781538007a tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.165713 Dec 18 03:20:41.042908 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 469/969] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:40 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:20:41.462969 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-fb08c362-618a-4255-8de9-6cc29d451c1d req-8f87fa35-4047-4ecb-a026-b821aef23b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b643a05-8259-4a3b-a274-23652c18a879", "name": "network-vif-plugged", "status": "completed", "tag": "bc34ae5c-b28d-4f84-bfcf-c60e402449ba"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:41.465476 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:20:41.465476 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:20:41.473000 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-fb08c362-618a-4255-8de9-6cc29d451c1d req-8f87fa35-4047-4ecb-a026-b821aef23b2c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:41.473449 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-fb08c362-618a-4255-8de9-6cc29d451c1d req-8f87fa35-4047-4ecb-a026-b821aef23b2c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:41.485502 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-fb08c362-618a-4255-8de9-6cc29d451c1d req-8f87fa35-4047-4ecb-a026-b821aef23b2c service nova] Creating event network-vif-plugged:bc34ae5c-b28d-4f84-bfcf-c60e402449ba for instance 4b643a05-8259-4a3b-a274-23652c18a879 on hv-cinder-81803 Dec 18 03:20:41.490199 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-fb08c362-618a-4255-8de9-6cc29d451c1d req-8f87fa35-4047-4ecb-a026-b821aef23b2c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031925 Dec 18 03:20:41.490781 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 501/970] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:20:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:20:42.059184 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4333841d-af58-4d6b-a9d7-7b32ee765b8d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:42.059787 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4333841d-af58-4d6b-a9d7-7b32ee765b8d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:42.066007 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4333841d-af58-4d6b-a9d7-7b32ee765b8d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:42.066457 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4333841d-af58-4d6b-a9d7-7b32ee765b8d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:42.067220 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4333841d-af58-4d6b-a9d7-7b32ee765b8d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:42.067648 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4333841d-af58-4d6b-a9d7-7b32ee765b8d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:42.198122 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4333841d-af58-4d6b-a9d7-7b32ee765b8d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:42.205904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4333841d-af58-4d6b-a9d7-7b32ee765b8d tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1264 microversion: 2.1 time: 0.150486 Dec 18 03:20:42.206467 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 470/971] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:42 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:43.223837 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-74a4d42c-f5e1-441c-8bde-0a9fb8eb2f00 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:43.224531 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-74a4d42c-f5e1-441c-8bde-0a9fb8eb2f00 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:43.231441 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-74a4d42c-f5e1-441c-8bde-0a9fb8eb2f00 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:43.231877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-74a4d42c-f5e1-441c-8bde-0a9fb8eb2f00 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:43.232639 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-74a4d42c-f5e1-441c-8bde-0a9fb8eb2f00 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:43.233065 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-74a4d42c-f5e1-441c-8bde-0a9fb8eb2f00 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:43.367031 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-74a4d42c-f5e1-441c-8bde-0a9fb8eb2f00 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:43.374313 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-74a4d42c-f5e1-441c-8bde-0a9fb8eb2f00 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1451 microversion: 2.1 time: 0.154944 Dec 18 03:20:43.374883 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 502/972] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:43 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:43.389974 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-bdee044d-33ae-4cb7-875e-61803ef81ff7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:43.390581 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-bdee044d-33ae-4cb7-875e-61803ef81ff7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:43.396752 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bdee044d-33ae-4cb7-875e-61803ef81ff7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:43.397202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bdee044d-33ae-4cb7-875e-61803ef81ff7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:43.398014 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bdee044d-33ae-4cb7-875e-61803ef81ff7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:43.398451 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-bdee044d-33ae-4cb7-875e-61803ef81ff7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:43.529277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-bdee044d-33ae-4cb7-875e-61803ef81ff7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:43.536560 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-bdee044d-33ae-4cb7-875e-61803ef81ff7 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1451 microversion: 2.1 time: 0.150301 Dec 18 03:20:43.537107 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 471/973] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:43 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:45.527748 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-ffcc5a55-b5b3-41e1-ac65-dc1f5b5d0852 req-2ae09725-6d73-4e76-a2f4-8c7b8fd7eb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b643a05-8259-4a3b-a274-23652c18a879", "tag": "bc34ae5c-b28d-4f84-bfcf-c60e402449ba"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:45.529465 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:20:45.529465 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:20:45.536820 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-ffcc5a55-b5b3-41e1-ac65-dc1f5b5d0852 req-2ae09725-6d73-4e76-a2f4-8c7b8fd7eb8d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:45.537262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-ffcc5a55-b5b3-41e1-ac65-dc1f5b5d0852 req-2ae09725-6d73-4e76-a2f4-8c7b8fd7eb8d service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:45.548765 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-ffcc5a55-b5b3-41e1-ac65-dc1f5b5d0852 req-2ae09725-6d73-4e76-a2f4-8c7b8fd7eb8d service nova] Creating event network-changed:bc34ae5c-b28d-4f84-bfcf-c60e402449ba for instance 4b643a05-8259-4a3b-a274-23652c18a879 on hv-cinder-81803 Dec 18 03:20:45.553768 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-ffcc5a55-b5b3-41e1-ac65-dc1f5b5d0852 req-2ae09725-6d73-4e76-a2f4-8c7b8fd7eb8d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030126 Dec 18 03:20:45.554758 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 503/974] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:20:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:20:48.400084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f0310c82-acd1-4e56-9a31-dc0fd7dcf723 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:20:48.406727 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f0310c82-acd1-4e56-9a31-dc0fd7dcf723 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:48.407174 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f0310c82-acd1-4e56-9a31-dc0fd7dcf723 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:48.466309 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f0310c82-acd1-4e56-9a31-dc0fd7dcf723 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Going to try to stop instance {{(pid=116000) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 03:20:48.507645 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f0310c82-acd1-4e56-9a31-dc0fd7dcf723 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 202 len: 0 microversion: 2.1 time: 0.111063 Dec 18 03:20:48.508255 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 472/975] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:20:48 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:20:48.516576 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e9e30a41-469e-4678-a932-b7ef6faf494d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:48.517271 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e9e30a41-469e-4678-a932-b7ef6faf494d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:48.523743 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e9e30a41-469e-4678-a932-b7ef6faf494d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:48.524160 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e9e30a41-469e-4678-a932-b7ef6faf494d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:48.524902 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e9e30a41-469e-4678-a932-b7ef6faf494d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:48.525337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e9e30a41-469e-4678-a932-b7ef6faf494d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:48.655836 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e9e30a41-469e-4678-a932-b7ef6faf494d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:48.663534 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e9e30a41-469e-4678-a932-b7ef6faf494d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.150900 Dec 18 03:20:48.664089 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 504/976] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:48 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:49.681534 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7c33aaf7-7d19-4839-8992-7237b28556fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:49.682185 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7c33aaf7-7d19-4839-8992-7237b28556fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:49.689135 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7c33aaf7-7d19-4839-8992-7237b28556fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:49.689585 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7c33aaf7-7d19-4839-8992-7237b28556fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:49.690394 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7c33aaf7-7d19-4839-8992-7237b28556fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:49.690838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7c33aaf7-7d19-4839-8992-7237b28556fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:49.825913 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-7c33aaf7-7d19-4839-8992-7237b28556fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:49.833610 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7c33aaf7-7d19-4839-8992-7237b28556fa tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.156241 Dec 18 03:20:49.834193 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 473/977] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:49 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:50.851199 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4143fb77-6f3e-4948-8957-f46a701cddd8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:50.851796 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4143fb77-6f3e-4948-8957-f46a701cddd8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:50.859028 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4143fb77-6f3e-4948-8957-f46a701cddd8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:50.859474 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4143fb77-6f3e-4948-8957-f46a701cddd8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:50.860243 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4143fb77-6f3e-4948-8957-f46a701cddd8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:50.860668 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4143fb77-6f3e-4948-8957-f46a701cddd8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:50.989014 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4143fb77-6f3e-4948-8957-f46a701cddd8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:50.997691 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4143fb77-6f3e-4948-8957-f46a701cddd8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.150043 Dec 18 03:20:50.998299 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 505/978] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:50 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:52.014711 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-83dd67ef-c5a3-4f0e-bfe1-83a639105288 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:52.015324 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-83dd67ef-c5a3-4f0e-bfe1-83a639105288 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:52.021811 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-83dd67ef-c5a3-4f0e-bfe1-83a639105288 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:52.022260 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-83dd67ef-c5a3-4f0e-bfe1-83a639105288 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:52.023042 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-83dd67ef-c5a3-4f0e-bfe1-83a639105288 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:52.023474 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-83dd67ef-c5a3-4f0e-bfe1-83a639105288 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:52.152018 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-83dd67ef-c5a3-4f0e-bfe1-83a639105288 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:52.159980 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-83dd67ef-c5a3-4f0e-bfe1-83a639105288 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.149176 Dec 18 03:20:52.160548 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 474/979] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:52 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:20:53.179005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-72d6ebd1-0109-424d-b62e-6e598ca752c8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:53.179549 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-72d6ebd1-0109-424d-b62e-6e598ca752c8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:53.186359 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-72d6ebd1-0109-424d-b62e-6e598ca752c8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:53.186798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-72d6ebd1-0109-424d-b62e-6e598ca752c8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:53.187560 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-72d6ebd1-0109-424d-b62e-6e598ca752c8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:53.187984 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-72d6ebd1-0109-424d-b62e-6e598ca752c8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:53.314595 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-72d6ebd1-0109-424d-b62e-6e598ca752c8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:53.322362 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-72d6ebd1-0109-424d-b62e-6e598ca752c8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.147126 Dec 18 03:20:53.322921 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 506/980] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:53 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:54.339036 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f3a87870-8e4d-44c7-a55b-9999506a1202 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:54.339648 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f3a87870-8e4d-44c7-a55b-9999506a1202 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:54.346628 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f3a87870-8e4d-44c7-a55b-9999506a1202 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:54.347069 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f3a87870-8e4d-44c7-a55b-9999506a1202 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:54.347834 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f3a87870-8e4d-44c7-a55b-9999506a1202 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:54.348262 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f3a87870-8e4d-44c7-a55b-9999506a1202 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:54.487157 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-f3a87870-8e4d-44c7-a55b-9999506a1202 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:54.494930 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f3a87870-8e4d-44c7-a55b-9999506a1202 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.159475 Dec 18 03:20:54.495491 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 475/981] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:54 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:55.512493 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-58a1cd74-4166-4e7a-b1fb-00972a87edf8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:55.513190 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-58a1cd74-4166-4e7a-b1fb-00972a87edf8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:55.519360 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-58a1cd74-4166-4e7a-b1fb-00972a87edf8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:55.519807 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-58a1cd74-4166-4e7a-b1fb-00972a87edf8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:55.520576 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-58a1cd74-4166-4e7a-b1fb-00972a87edf8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:55.521007 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-58a1cd74-4166-4e7a-b1fb-00972a87edf8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:55.653316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-58a1cd74-4166-4e7a-b1fb-00972a87edf8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:55.661039 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-58a1cd74-4166-4e7a-b1fb-00972a87edf8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.152667 Dec 18 03:20:55.661563 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 507/982] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:55 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:56.678622 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6bb59e5b-8f9d-4227-95c7-d07ac5aca879 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:56.679165 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-6bb59e5b-8f9d-4227-95c7-d07ac5aca879 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:56.685345 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6bb59e5b-8f9d-4227-95c7-d07ac5aca879 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:56.685823 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6bb59e5b-8f9d-4227-95c7-d07ac5aca879 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:56.686589 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6bb59e5b-8f9d-4227-95c7-d07ac5aca879 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:56.687013 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-6bb59e5b-8f9d-4227-95c7-d07ac5aca879 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:56.813177 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-6bb59e5b-8f9d-4227-95c7-d07ac5aca879 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:56.820772 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6bb59e5b-8f9d-4227-95c7-d07ac5aca879 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.146508 Dec 18 03:20:56.821329 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 476/983] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:56 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:57.837514 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5218ae23-ceb2-4270-b168-da6ec183caf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:57.838152 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5218ae23-ceb2-4270-b168-da6ec183caf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:57.845102 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5218ae23-ceb2-4270-b168-da6ec183caf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:57.845550 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5218ae23-ceb2-4270-b168-da6ec183caf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:57.846352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5218ae23-ceb2-4270-b168-da6ec183caf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:57.846824 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5218ae23-ceb2-4270-b168-da6ec183caf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:57.972657 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5218ae23-ceb2-4270-b168-da6ec183caf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:57.980688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5218ae23-ceb2-4270-b168-da6ec183caf2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.146745 Dec 18 03:20:57.981244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 508/984] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:57 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:20:58.998012 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1c74c288-366b-48c6-b9c3-280131276cde tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:20:58.998619 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1c74c288-366b-48c6-b9c3-280131276cde tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:20:59.004914 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c74c288-366b-48c6-b9c3-280131276cde tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:59.005358 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c74c288-366b-48c6-b9c3-280131276cde tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:59.006174 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c74c288-366b-48c6-b9c3-280131276cde tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:20:59.006606 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-1c74c288-366b-48c6-b9c3-280131276cde tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:20:59.136276 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1c74c288-366b-48c6-b9c3-280131276cde tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:20:59.144589 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1c74c288-366b-48c6-b9c3-280131276cde tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.150812 Dec 18 03:20:59.145148 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 477/985] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:20:58 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:00.161572 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8aa9377c-d14b-4307-ab16-fa6611bd53ed tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:00.162205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8aa9377c-d14b-4307-ab16-fa6611bd53ed tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:00.168733 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8aa9377c-d14b-4307-ab16-fa6611bd53ed tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:00.169181 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8aa9377c-d14b-4307-ab16-fa6611bd53ed tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:00.169986 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8aa9377c-d14b-4307-ab16-fa6611bd53ed tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:00.170418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8aa9377c-d14b-4307-ab16-fa6611bd53ed tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:00.296006 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-8aa9377c-d14b-4307-ab16-fa6611bd53ed tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:00.303831 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8aa9377c-d14b-4307-ab16-fa6611bd53ed tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.145912 Dec 18 03:21:00.304395 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 509/986] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:00 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:01.321216 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-712a1839-400d-4d4c-b31a-f5230db71ad8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:01.321851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-712a1839-400d-4d4c-b31a-f5230db71ad8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:01.328793 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-712a1839-400d-4d4c-b31a-f5230db71ad8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:01.329244 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-712a1839-400d-4d4c-b31a-f5230db71ad8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:01.330054 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-712a1839-400d-4d4c-b31a-f5230db71ad8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:01.330488 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-712a1839-400d-4d4c-b31a-f5230db71ad8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:01.457765 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-712a1839-400d-4d4c-b31a-f5230db71ad8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:01.465563 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-712a1839-400d-4d4c-b31a-f5230db71ad8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.147886 Dec 18 03:21:01.466153 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 478/987] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:01 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:02.483019 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f2dcff7b-2caa-49bf-b775-a64b41e2fbf3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:02.483619 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f2dcff7b-2caa-49bf-b775-a64b41e2fbf3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:02.490106 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f2dcff7b-2caa-49bf-b775-a64b41e2fbf3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:02.490546 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f2dcff7b-2caa-49bf-b775-a64b41e2fbf3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:02.491505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f2dcff7b-2caa-49bf-b775-a64b41e2fbf3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:02.491932 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f2dcff7b-2caa-49bf-b775-a64b41e2fbf3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:02.621250 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-f2dcff7b-2caa-49bf-b775-a64b41e2fbf3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:02.628964 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f2dcff7b-2caa-49bf-b775-a64b41e2fbf3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.150243 Dec 18 03:21:02.629517 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 510/988] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:02 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:03.646073 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-75177353-c898-4457-99a8-5b188b615320 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:03.646689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-75177353-c898-4457-99a8-5b188b615320 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:03.653151 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75177353-c898-4457-99a8-5b188b615320 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:03.653602 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75177353-c898-4457-99a8-5b188b615320 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:03.654411 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75177353-c898-4457-99a8-5b188b615320 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:03.654846 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75177353-c898-4457-99a8-5b188b615320 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:03.781293 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-75177353-c898-4457-99a8-5b188b615320 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:03.788958 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-75177353-c898-4457-99a8-5b188b615320 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1724 microversion: 2.1 time: 0.146542 Dec 18 03:21:03.789515 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 479/989] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:03 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:04.806402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2e8da4de-c6c1-462b-bc12-478a75c1d9d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:04.806928 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2e8da4de-c6c1-462b-bc12-478a75c1d9d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:04.813774 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e8da4de-c6c1-462b-bc12-478a75c1d9d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:04.814215 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e8da4de-c6c1-462b-bc12-478a75c1d9d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:04.814978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e8da4de-c6c1-462b-bc12-478a75c1d9d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:04.815403 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2e8da4de-c6c1-462b-bc12-478a75c1d9d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:04.942414 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2e8da4de-c6c1-462b-bc12-478a75c1d9d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:04.950136 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2e8da4de-c6c1-462b-bc12-478a75c1d9d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1701 microversion: 2.1 time: 0.147438 Dec 18 03:21:04.950746 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 511/990] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:04 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1701 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:04.966799 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-eb70eb19-5144-4f87-ad68-868e40c2eed9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:21:04.973159 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb70eb19-5144-4f87-ad68-868e40c2eed9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:04.973608 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-eb70eb19-5144-4f87-ad68-868e40c2eed9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:04.996701 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-eb70eb19-5144-4f87-ad68-868e40c2eed9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Going to try to start instance {{(pid=116000) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 18 03:21:05.037488 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-eb70eb19-5144-4f87-ad68-868e40c2eed9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 202 len: 0 microversion: 2.1 time: 0.074662 Dec 18 03:21:05.038147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 480/991] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:21:04 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:21:05.046769 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bef0196d-aff4-4a4b-b5a8-258e41478675 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:05.047376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-bef0196d-aff4-4a4b-b5a8-258e41478675 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:05.053418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bef0196d-aff4-4a4b-b5a8-258e41478675 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:05.054026 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bef0196d-aff4-4a4b-b5a8-258e41478675 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:05.054907 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bef0196d-aff4-4a4b-b5a8-258e41478675 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:05.055372 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-bef0196d-aff4-4a4b-b5a8-258e41478675 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:05.194863 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-bef0196d-aff4-4a4b-b5a8-258e41478675 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:05.202966 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bef0196d-aff4-4a4b-b5a8-258e41478675 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1710 microversion: 2.1 time: 0.160609 Dec 18 03:21:05.203543 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 512/992] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:05 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:06.219937 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3cd9a91c-bf52-41ca-8a75-42fab0e93df9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:06.220627 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3cd9a91c-bf52-41ca-8a75-42fab0e93df9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:06.227032 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cd9a91c-bf52-41ca-8a75-42fab0e93df9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:06.227470 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cd9a91c-bf52-41ca-8a75-42fab0e93df9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:06.228237 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cd9a91c-bf52-41ca-8a75-42fab0e93df9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:06.228664 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3cd9a91c-bf52-41ca-8a75-42fab0e93df9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:06.369155 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3cd9a91c-bf52-41ca-8a75-42fab0e93df9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:06.377956 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3cd9a91c-bf52-41ca-8a75-42fab0e93df9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1710 microversion: 2.1 time: 0.162153 Dec 18 03:21:06.378523 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 481/993] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:06 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:07.394943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2960e532-9fd7-4245-8ed4-2eda8f6aff1b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:07.395624 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2960e532-9fd7-4245-8ed4-2eda8f6aff1b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:07.401955 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2960e532-9fd7-4245-8ed4-2eda8f6aff1b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:07.402405 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2960e532-9fd7-4245-8ed4-2eda8f6aff1b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:07.403184 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2960e532-9fd7-4245-8ed4-2eda8f6aff1b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:07.403867 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2960e532-9fd7-4245-8ed4-2eda8f6aff1b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:07.534520 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2960e532-9fd7-4245-8ed4-2eda8f6aff1b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:07.542251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2960e532-9fd7-4245-8ed4-2eda8f6aff1b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1714 microversion: 2.1 time: 0.150985 Dec 18 03:21:07.542814 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 513/994] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:07 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:32.329226 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7d044f8e-4167-4961-a73a-a4ec8c966b78 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:21:32.329783 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-7d044f8e-4167-4961-a73a-a4ec8c966b78 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:32.335564 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d044f8e-4167-4961-a73a-a4ec8c966b78 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:32.336003 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d044f8e-4167-4961-a73a-a4ec8c966b78 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:32.336769 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d044f8e-4167-4961-a73a-a4ec8c966b78 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:32.337195 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-7d044f8e-4167-4961-a73a-a4ec8c966b78 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:32.360481 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-7d044f8e-4167-4961-a73a-a4ec8c966b78 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lazy-loading 'flavor' on Instance uuid d244df22-21b2-40e5-972f-e6678258f781 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:21:32.433092 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7d044f8e-4167-4961-a73a-a4ec8c966b78 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "POST /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781/action" status: 202 len: 0 microversion: 2.1 time: 0.107481 Dec 18 03:21:32.437739 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 482/995] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:21:32 2021] POST /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:21:32.443798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e75d9897-0eb1-460f-b10a-2fd27fd906db tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:32.444419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e75d9897-0eb1-460f-b10a-2fd27fd906db tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:32.450500 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e75d9897-0eb1-460f-b10a-2fd27fd906db tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:32.450964 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e75d9897-0eb1-460f-b10a-2fd27fd906db tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:32.452232 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e75d9897-0eb1-460f-b10a-2fd27fd906db tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:32.452716 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e75d9897-0eb1-460f-b10a-2fd27fd906db tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:32.587106 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e75d9897-0eb1-460f-b10a-2fd27fd906db tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:32.595248 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e75d9897-0eb1-460f-b10a-2fd27fd906db tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.156126 Dec 18 03:21:32.595811 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 514/996] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:32 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:33.617677 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-23340518-8f0f-4ecf-b18f-e9ad99143095 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:33.618380 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-23340518-8f0f-4ecf-b18f-e9ad99143095 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:33.625047 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23340518-8f0f-4ecf-b18f-e9ad99143095 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:33.625491 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23340518-8f0f-4ecf-b18f-e9ad99143095 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:33.626295 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23340518-8f0f-4ecf-b18f-e9ad99143095 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:33.626726 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23340518-8f0f-4ecf-b18f-e9ad99143095 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:33.757723 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-23340518-8f0f-4ecf-b18f-e9ad99143095 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:33.765018 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-23340518-8f0f-4ecf-b18f-e9ad99143095 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.151892 Dec 18 03:21:33.765578 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 483/997] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:33 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:34.782445 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-23286026-6b5a-4b1d-b95a-f34b4e2c8b86 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:34.782977 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-23286026-6b5a-4b1d-b95a-f34b4e2c8b86 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:34.789238 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23286026-6b5a-4b1d-b95a-f34b4e2c8b86 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:34.789722 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23286026-6b5a-4b1d-b95a-f34b4e2c8b86 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:34.790505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23286026-6b5a-4b1d-b95a-f34b4e2c8b86 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:34.790938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23286026-6b5a-4b1d-b95a-f34b4e2c8b86 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:34.923661 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-23286026-6b5a-4b1d-b95a-f34b4e2c8b86 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:34.930854 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-23286026-6b5a-4b1d-b95a-f34b4e2c8b86 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.152972 Dec 18 03:21:34.931410 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 515/998] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:34 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:35.948324 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9fe0f6dd-39c0-48a2-8d6a-8c028c3cd910 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:35.948930 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9fe0f6dd-39c0-48a2-8d6a-8c028c3cd910 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:35.955729 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9fe0f6dd-39c0-48a2-8d6a-8c028c3cd910 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:35.956172 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9fe0f6dd-39c0-48a2-8d6a-8c028c3cd910 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:35.956945 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9fe0f6dd-39c0-48a2-8d6a-8c028c3cd910 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:35.957374 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9fe0f6dd-39c0-48a2-8d6a-8c028c3cd910 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:36.084372 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-9fe0f6dd-39c0-48a2-8d6a-8c028c3cd910 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:36.093298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9fe0f6dd-39c0-48a2-8d6a-8c028c3cd910 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.148600 Dec 18 03:21:36.093894 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 484/999] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:35 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:36.270995 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:21:36.270995 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: Sat Dec 18 03:21:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 03:21:37.111536 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c3e0cfc7-e64a-4dc3-a3ad-14916f32c76a tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:37.112143 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c3e0cfc7-e64a-4dc3-a3ad-14916f32c76a tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:37.118493 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c3e0cfc7-e64a-4dc3-a3ad-14916f32c76a tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:37.118933 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c3e0cfc7-e64a-4dc3-a3ad-14916f32c76a tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:37.119708 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c3e0cfc7-e64a-4dc3-a3ad-14916f32c76a tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:37.120139 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c3e0cfc7-e64a-4dc3-a3ad-14916f32c76a tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:37.248976 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-c3e0cfc7-e64a-4dc3-a3ad-14916f32c76a tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:37.256167 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c3e0cfc7-e64a-4dc3-a3ad-14916f32c76a tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.149560 Dec 18 03:21:37.256746 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 516/1000] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:37 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:38.272170 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-581ef083-b7e1-4e3b-b965-8782e65ea2a9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:38.272809 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-581ef083-b7e1-4e3b-b965-8782e65ea2a9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:38.279037 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-581ef083-b7e1-4e3b-b965-8782e65ea2a9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:38.279484 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-581ef083-b7e1-4e3b-b965-8782e65ea2a9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:38.280243 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-581ef083-b7e1-4e3b-b965-8782e65ea2a9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:38.280674 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-581ef083-b7e1-4e3b-b965-8782e65ea2a9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:38.412918 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-581ef083-b7e1-4e3b-b965-8782e65ea2a9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:38.420667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-581ef083-b7e1-4e3b-b965-8782e65ea2a9 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.152236 Dec 18 03:21:38.421229 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 485/1001] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:38 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:39.437773 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-03b4db84-b4b8-420c-98af-52bc59c18a29 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:39.438407 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-03b4db84-b4b8-420c-98af-52bc59c18a29 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:39.444636 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-03b4db84-b4b8-420c-98af-52bc59c18a29 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:39.445076 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-03b4db84-b4b8-420c-98af-52bc59c18a29 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:39.445862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-03b4db84-b4b8-420c-98af-52bc59c18a29 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:39.446292 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-03b4db84-b4b8-420c-98af-52bc59c18a29 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:39.578458 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-03b4db84-b4b8-420c-98af-52bc59c18a29 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:39.585646 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-03b4db84-b4b8-420c-98af-52bc59c18a29 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.152084 Dec 18 03:21:39.586215 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 517/1002] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:39 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:40.042272 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b2507c3d-81ef-4f50-8900-ade5cdcf1662 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:40.042838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b2507c3d-81ef-4f50-8900-ade5cdcf1662 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:40.049006 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b2507c3d-81ef-4f50-8900-ade5cdcf1662 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:40.049456 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b2507c3d-81ef-4f50-8900-ade5cdcf1662 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:40.050261 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b2507c3d-81ef-4f50-8900-ade5cdcf1662 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:40.050697 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b2507c3d-81ef-4f50-8900-ade5cdcf1662 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:40.127325 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-b2507c3d-81ef-4f50-8900-ade5cdcf1662 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lazy-loading 'services' on Instance uuid 1d21616b-5525-492c-a7ac-85e63612742a {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:21:40.194449 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b2507c3d-81ef-4f50-8900-ade5cdcf1662 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/os-volume_attachments/21cb29aa-650b-4c29-80e2-e0677f55ba9f" status: 202 len: 0 microversion: 2.1 time: 0.155671 Dec 18 03:21:40.198068 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 486/1003] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:21:40 2021] DELETE /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/os-volume_attachments/21cb29aa-650b-4c29-80e2-e0677f55ba9f => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:21:40.602187 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2d1ece3c-9456-4f4a-b63f-80d2fa143282 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:40.602797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2d1ece3c-9456-4f4a-b63f-80d2fa143282 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:40.609948 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2d1ece3c-9456-4f4a-b63f-80d2fa143282 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:40.610393 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2d1ece3c-9456-4f4a-b63f-80d2fa143282 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:40.611167 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2d1ece3c-9456-4f4a-b63f-80d2fa143282 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:40.611595 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2d1ece3c-9456-4f4a-b63f-80d2fa143282 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:40.755570 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-2d1ece3c-9456-4f4a-b63f-80d2fa143282 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:40.763434 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2d1ece3c-9456-4f4a-b63f-80d2fa143282 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.164418 Dec 18 03:21:40.763983 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 518/1004] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:40 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:41.301956 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-23f3e2f7-4165-434e-bc79-9d3bca7eb3f4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:21:41.308060 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23f3e2f7-4165-434e-bc79-9d3bca7eb3f4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:41.308506 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-23f3e2f7-4165-434e-bc79-9d3bca7eb3f4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:41.330548 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-23f3e2f7-4165-434e-bc79-9d3bca7eb3f4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Going to try to stop instance {{(pid=116000) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 18 03:21:41.370983 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-23f3e2f7-4165-434e-bc79-9d3bca7eb3f4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 202 len: 0 microversion: 2.1 time: 0.073185 Dec 18 03:21:41.371789 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 487/1005] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:21:41 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:21:41.380359 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6c278314-e65d-438e-9d42-0c6d99e84298 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:41.380968 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6c278314-e65d-438e-9d42-0c6d99e84298 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:41.386766 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c278314-e65d-438e-9d42-0c6d99e84298 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:41.387200 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c278314-e65d-438e-9d42-0c6d99e84298 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:41.388138 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c278314-e65d-438e-9d42-0c6d99e84298 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:41.388612 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6c278314-e65d-438e-9d42-0c6d99e84298 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:41.522600 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6c278314-e65d-438e-9d42-0c6d99e84298 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:41.531190 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6c278314-e65d-438e-9d42-0c6d99e84298 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1678 microversion: 2.1 time: 0.154438 Dec 18 03:21:41.531750 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 519/1006] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:41 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:41.780473 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-828ae30b-030a-45ee-a714-3f17bb89f92f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:41.781092 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-828ae30b-030a-45ee-a714-3f17bb89f92f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:41.787185 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-828ae30b-030a-45ee-a714-3f17bb89f92f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:41.787629 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-828ae30b-030a-45ee-a714-3f17bb89f92f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:41.788397 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-828ae30b-030a-45ee-a714-3f17bb89f92f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:41.788828 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-828ae30b-030a-45ee-a714-3f17bb89f92f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:41.917053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-828ae30b-030a-45ee-a714-3f17bb89f92f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:41.924558 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-828ae30b-030a-45ee-a714-3f17bb89f92f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.148204 Dec 18 03:21:41.925113 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 488/1007] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:41 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:42.548787 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6eaeabfd-2556-40f5-b97e-28d74384497a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:42.549397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6eaeabfd-2556-40f5-b97e-28d74384497a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:42.555734 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6eaeabfd-2556-40f5-b97e-28d74384497a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:42.556178 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6eaeabfd-2556-40f5-b97e-28d74384497a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:42.556945 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6eaeabfd-2556-40f5-b97e-28d74384497a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:42.557377 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6eaeabfd-2556-40f5-b97e-28d74384497a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:42.682910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6eaeabfd-2556-40f5-b97e-28d74384497a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:42.690275 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6eaeabfd-2556-40f5-b97e-28d74384497a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1678 microversion: 2.1 time: 0.145137 Dec 18 03:21:42.690833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 520/1008] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:42 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:42.941014 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-ae971353-30d7-439d-a44f-65d814153d63 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:42.941709 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-ae971353-30d7-439d-a44f-65d814153d63 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:42.947904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ae971353-30d7-439d-a44f-65d814153d63 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:42.948355 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ae971353-30d7-439d-a44f-65d814153d63 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:42.949134 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ae971353-30d7-439d-a44f-65d814153d63 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:42.949567 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-ae971353-30d7-439d-a44f-65d814153d63 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:43.155202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-ae971353-30d7-439d-a44f-65d814153d63 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:43.162423 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-ae971353-30d7-439d-a44f-65d814153d63 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.225090 Dec 18 03:21:43.162989 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 489/1009] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:42 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:43.706919 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-89895bb1-61c1-485e-b820-42d22ed4672c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:43.707529 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-89895bb1-61c1-485e-b820-42d22ed4672c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:43.713825 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89895bb1-61c1-485e-b820-42d22ed4672c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:43.714276 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89895bb1-61c1-485e-b820-42d22ed4672c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:43.715050 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89895bb1-61c1-485e-b820-42d22ed4672c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:43.715484 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-89895bb1-61c1-485e-b820-42d22ed4672c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:43.844552 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-89895bb1-61c1-485e-b820-42d22ed4672c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:43.851833 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-89895bb1-61c1-485e-b820-42d22ed4672c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1678 microversion: 2.1 time: 0.148579 Dec 18 03:21:43.852385 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 521/1010] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:43 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:44.179231 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-492189e1-bb39-435f-97cd-b677b1abec5e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:44.179838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-492189e1-bb39-435f-97cd-b677b1abec5e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:44.186801 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-492189e1-bb39-435f-97cd-b677b1abec5e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:44.187239 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-492189e1-bb39-435f-97cd-b677b1abec5e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:44.188004 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-492189e1-bb39-435f-97cd-b677b1abec5e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:44.188428 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-492189e1-bb39-435f-97cd-b677b1abec5e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:44.321299 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-492189e1-bb39-435f-97cd-b677b1abec5e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:44.328773 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-492189e1-bb39-435f-97cd-b677b1abec5e tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.153151 Dec 18 03:21:44.329332 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 490/1011] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:44 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:44.869466 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5f32c9fc-df9f-4b81-aabc-81065c0421a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:44.870097 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5f32c9fc-df9f-4b81-aabc-81065c0421a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:44.876609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5f32c9fc-df9f-4b81-aabc-81065c0421a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:44.877098 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5f32c9fc-df9f-4b81-aabc-81065c0421a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:44.877920 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5f32c9fc-df9f-4b81-aabc-81065c0421a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:44.878360 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5f32c9fc-df9f-4b81-aabc-81065c0421a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:45.015970 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-5f32c9fc-df9f-4b81-aabc-81065c0421a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:45.023291 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5f32c9fc-df9f-4b81-aabc-81065c0421a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1678 microversion: 2.1 time: 0.157502 Dec 18 03:21:45.023855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 522/1012] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:44 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:45.346081 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-31e9878e-abf1-4cde-be83-3de89fc63f34 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:45.346698 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-31e9878e-abf1-4cde-be83-3de89fc63f34 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:45.352868 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-31e9878e-abf1-4cde-be83-3de89fc63f34 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:45.353319 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-31e9878e-abf1-4cde-be83-3de89fc63f34 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:45.354125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-31e9878e-abf1-4cde-be83-3de89fc63f34 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:45.354566 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-31e9878e-abf1-4cde-be83-3de89fc63f34 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:45.487798 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-31e9878e-abf1-4cde-be83-3de89fc63f34 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:45.495108 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-31e9878e-abf1-4cde-be83-3de89fc63f34 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1568 microversion: 2.1 time: 0.152760 Dec 18 03:21:45.495675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 491/1013] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:45 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:45.511456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ad99340c-ddb0-44f7-b77b-1486f2d5480f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:21:45.512019 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ad99340c-ddb0-44f7-b77b-1486f2d5480f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:45.518471 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad99340c-ddb0-44f7-b77b-1486f2d5480f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:45.518917 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad99340c-ddb0-44f7-b77b-1486f2d5480f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:45.519690 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad99340c-ddb0-44f7-b77b-1486f2d5480f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:45.520122 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ad99340c-ddb0-44f7-b77b-1486f2d5480f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:45.592252 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ad99340c-ddb0-44f7-b77b-1486f2d5480f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "POST /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781/action" status: 202 len: 0 microversion: 2.1 time: 0.084412 Dec 18 03:21:45.592866 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 523/1014] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:21:45 2021] POST /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:21:45.600613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-98657923-f48d-4e51-8dbf-ac01d1694bc8 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:45.601252 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-98657923-f48d-4e51-8dbf-ac01d1694bc8 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:45.607256 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-98657923-f48d-4e51-8dbf-ac01d1694bc8 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:45.607678 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-98657923-f48d-4e51-8dbf-ac01d1694bc8 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:45.608454 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-98657923-f48d-4e51-8dbf-ac01d1694bc8 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:45.608882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-98657923-f48d-4e51-8dbf-ac01d1694bc8 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:45.783424 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-98657923-f48d-4e51-8dbf-ac01d1694bc8 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:45.790677 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-98657923-f48d-4e51-8dbf-ac01d1694bc8 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1576 microversion: 2.1 time: 0.193657 Dec 18 03:21:45.791244 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 492/1015] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:45 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:46.041150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-110e528d-0146-4419-915a-f59b190aacbf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:46.041724 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-110e528d-0146-4419-915a-f59b190aacbf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:46.048357 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-110e528d-0146-4419-915a-f59b190aacbf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:46.048807 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-110e528d-0146-4419-915a-f59b190aacbf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:46.049635 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-110e528d-0146-4419-915a-f59b190aacbf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:46.050081 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-110e528d-0146-4419-915a-f59b190aacbf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:46.183049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-110e528d-0146-4419-915a-f59b190aacbf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:46.191645 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-110e528d-0146-4419-915a-f59b190aacbf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1678 microversion: 2.1 time: 0.154650 Dec 18 03:21:46.192204 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 524/1016] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:46 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:46.808105 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c9144969-4ea6-4f5d-824c-d07b8565dfb2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:46.808717 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c9144969-4ea6-4f5d-824c-d07b8565dfb2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:46.815617 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c9144969-4ea6-4f5d-824c-d07b8565dfb2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:46.816061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c9144969-4ea6-4f5d-824c-d07b8565dfb2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:46.816835 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c9144969-4ea6-4f5d-824c-d07b8565dfb2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:46.817267 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c9144969-4ea6-4f5d-824c-d07b8565dfb2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:46.954549 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c9144969-4ea6-4f5d-824c-d07b8565dfb2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:46.961886 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c9144969-4ea6-4f5d-824c-d07b8565dfb2 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1518 microversion: 2.1 time: 0.157367 Dec 18 03:21:46.962667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 493/1017] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:46 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:47.209595 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-256ea143-73f4-492e-9c51-21585786f325 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:47.210195 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-256ea143-73f4-492e-9c51-21585786f325 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:47.217061 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-256ea143-73f4-492e-9c51-21585786f325 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:47.217506 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-256ea143-73f4-492e-9c51-21585786f325 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:47.218315 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-256ea143-73f4-492e-9c51-21585786f325 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:47.218748 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-256ea143-73f4-492e-9c51-21585786f325 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:47.354558 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-256ea143-73f4-492e-9c51-21585786f325 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:47.362656 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-256ea143-73f4-492e-9c51-21585786f325 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1678 microversion: 2.1 time: 0.156815 Dec 18 03:21:47.363414 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 525/1018] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:47 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:47.979472 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2288c5f0-f7ff-408d-b891-25b573bafbe5 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:47.980334 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2288c5f0-f7ff-408d-b891-25b573bafbe5 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:47.987113 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2288c5f0-f7ff-408d-b891-25b573bafbe5 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:47.987561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2288c5f0-f7ff-408d-b891-25b573bafbe5 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:47.988335 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2288c5f0-f7ff-408d-b891-25b573bafbe5 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:47.988770 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2288c5f0-f7ff-408d-b891-25b573bafbe5 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:48.123181 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-2288c5f0-f7ff-408d-b891-25b573bafbe5 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:48.130458 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2288c5f0-f7ff-408d-b891-25b573bafbe5 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1574 microversion: 2.1 time: 0.154677 Dec 18 03:21:48.131017 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 494/1019] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:47 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:48.379408 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-757994e3-91a9-4136-b85b-546e218ec1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:48.380016 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-757994e3-91a9-4136-b85b-546e218ec1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:48.386008 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-757994e3-91a9-4136-b85b-546e218ec1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:48.386456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-757994e3-91a9-4136-b85b-546e218ec1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:48.387228 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-757994e3-91a9-4136-b85b-546e218ec1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:48.387717 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-757994e3-91a9-4136-b85b-546e218ec1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:48.523030 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-757994e3-91a9-4136-b85b-546e218ec1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:48.530898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-757994e3-91a9-4136-b85b-546e218ec1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1678 microversion: 2.1 time: 0.155144 Dec 18 03:21:48.531455 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 526/1020] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:48 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:49.147700 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-81d6a833-7f1a-4859-90e7-051097297023 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:49.148304 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-81d6a833-7f1a-4859-90e7-051097297023 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:49.154221 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-81d6a833-7f1a-4859-90e7-051097297023 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:49.154670 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-81d6a833-7f1a-4859-90e7-051097297023 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:49.155441 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-81d6a833-7f1a-4859-90e7-051097297023 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:49.155873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-81d6a833-7f1a-4859-90e7-051097297023 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:49.283268 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-81d6a833-7f1a-4859-90e7-051097297023 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:49.290682 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-81d6a833-7f1a-4859-90e7-051097297023 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1574 microversion: 2.1 time: 0.146811 Dec 18 03:21:49.291245 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 495/1021] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:49 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:49.548345 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-aca4c943-c340-4f41-9b89-013626e1b20c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:49.548947 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-aca4c943-c340-4f41-9b89-013626e1b20c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:49.555166 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aca4c943-c340-4f41-9b89-013626e1b20c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:49.555608 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aca4c943-c340-4f41-9b89-013626e1b20c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:49.556381 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aca4c943-c340-4f41-9b89-013626e1b20c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:49.556808 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-aca4c943-c340-4f41-9b89-013626e1b20c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:49.683713 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-aca4c943-c340-4f41-9b89-013626e1b20c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:49.691660 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-aca4c943-c340-4f41-9b89-013626e1b20c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1678 microversion: 2.1 time: 0.147604 Dec 18 03:21:49.692224 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 527/1022] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:49 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:49.871336 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-f14fa10f-76bb-486c-bf40-a978a031d7e3 req-9d188e05-1c54-4efc-bd01-bea603fcc356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d244df22-21b2-40e5-972f-e6678258f781", "name": "network-vif-unplugged", "status": "completed", "tag": "60bc3098-1a05-43da-aad1-0105b3137056"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:21:49.872997 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:21:49.872997 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:21:49.880492 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-f14fa10f-76bb-486c-bf40-a978a031d7e3 req-9d188e05-1c54-4efc-bd01-bea603fcc356 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:49.880940 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-f14fa10f-76bb-486c-bf40-a978a031d7e3 req-9d188e05-1c54-4efc-bd01-bea603fcc356 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:49.891872 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-f14fa10f-76bb-486c-bf40-a978a031d7e3 req-9d188e05-1c54-4efc-bd01-bea603fcc356 service nova] Creating event network-vif-unplugged:60bc3098-1a05-43da-aad1-0105b3137056 for instance d244df22-21b2-40e5-972f-e6678258f781 on hv-cinder-81803 Dec 18 03:21:49.896719 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-f14fa10f-76bb-486c-bf40-a978a031d7e3 req-9d188e05-1c54-4efc-bd01-bea603fcc356 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029032 Dec 18 03:21:49.897306 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 496/1023] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:21:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:21:50.307797 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-93c6345b-6491-4bd1-9d31-3bacf6680167 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:50.308313 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-93c6345b-6491-4bd1-9d31-3bacf6680167 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:50.314251 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-93c6345b-6491-4bd1-9d31-3bacf6680167 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:50.314697 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-93c6345b-6491-4bd1-9d31-3bacf6680167 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:50.315459 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-93c6345b-6491-4bd1-9d31-3bacf6680167 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:50.315882 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-93c6345b-6491-4bd1-9d31-3bacf6680167 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:50.447390 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-93c6345b-6491-4bd1-9d31-3bacf6680167 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:50.455287 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-93c6345b-6491-4bd1-9d31-3bacf6680167 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1574 microversion: 2.1 time: 0.151210 Dec 18 03:21:50.455840 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 528/1024] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:50 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:50.708964 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-86f6f0e2-b6ff-4850-b4d8-2f5932afb466 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:50.709717 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-86f6f0e2-b6ff-4850-b4d8-2f5932afb466 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:50.716059 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86f6f0e2-b6ff-4850-b4d8-2f5932afb466 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:50.716494 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86f6f0e2-b6ff-4850-b4d8-2f5932afb466 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:50.717259 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86f6f0e2-b6ff-4850-b4d8-2f5932afb466 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:50.717719 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-86f6f0e2-b6ff-4850-b4d8-2f5932afb466 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:51.112882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-86f6f0e2-b6ff-4850-b4d8-2f5932afb466 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:51.120178 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-86f6f0e2-b6ff-4850-b4d8-2f5932afb466 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1678 microversion: 2.1 time: 0.415737 Dec 18 03:21:51.120743 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 497/1025] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:50 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1678 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:51.472176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e004e877-80f2-43c5-80f4-fbd47f742726 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:51.472816 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e004e877-80f2-43c5-80f4-fbd47f742726 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:51.479155 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e004e877-80f2-43c5-80f4-fbd47f742726 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:51.479604 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e004e877-80f2-43c5-80f4-fbd47f742726 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:51.480645 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e004e877-80f2-43c5-80f4-fbd47f742726 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:51.481081 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e004e877-80f2-43c5-80f4-fbd47f742726 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:51.610145 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e004e877-80f2-43c5-80f4-fbd47f742726 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:51.617415 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e004e877-80f2-43c5-80f4-fbd47f742726 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1574 microversion: 2.1 time: 0.148880 Dec 18 03:21:51.618015 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 529/1026] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:51 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:52.139200 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-97af319f-f5c6-4402-b751-84040583ff05 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:52.139795 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-97af319f-f5c6-4402-b751-84040583ff05 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:52.146092 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97af319f-f5c6-4402-b751-84040583ff05 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:52.146539 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97af319f-f5c6-4402-b751-84040583ff05 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:52.147394 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97af319f-f5c6-4402-b751-84040583ff05 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:52.147830 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-97af319f-f5c6-4402-b751-84040583ff05 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:52.275731 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-97af319f-f5c6-4402-b751-84040583ff05 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:52.282937 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-97af319f-f5c6-4402-b751-84040583ff05 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1655 microversion: 2.1 time: 0.148165 Dec 18 03:21:52.283497 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 498/1027] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:52 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:52.299041 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-3fcd7233-c29d-4f4e-95e1-42502e3b6683 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:21:52.304825 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fcd7233-c29d-4f4e-95e1-42502e3b6683 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:52.305275 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-3fcd7233-c29d-4f4e-95e1-42502e3b6683 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:52.366238 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-3fcd7233-c29d-4f4e-95e1-42502e3b6683 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Going to try to start instance {{(pid=116001) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 18 03:21:52.407612 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-3fcd7233-c29d-4f4e-95e1-42502e3b6683 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action" status: 202 len: 0 microversion: 2.1 time: 0.111968 Dec 18 03:21:52.408322 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 530/1028] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:21:52 2021] POST /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:21:52.416194 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4086cf40-99e4-46b6-8209-d4e63e5b710d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:52.416810 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-4086cf40-99e4-46b6-8209-d4e63e5b710d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:52.425501 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4086cf40-99e4-46b6-8209-d4e63e5b710d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:52.426062 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4086cf40-99e4-46b6-8209-d4e63e5b710d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:52.426844 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4086cf40-99e4-46b6-8209-d4e63e5b710d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:52.427276 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-4086cf40-99e4-46b6-8209-d4e63e5b710d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:52.590585 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-4086cf40-99e4-46b6-8209-d4e63e5b710d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:52.597949 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4086cf40-99e4-46b6-8209-d4e63e5b710d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1664 microversion: 2.1 time: 0.185419 Dec 18 03:21:52.598523 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 499/1029] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:52 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1664 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:52.635138 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-70334e62-242e-4f29-9f04-40704f20f6d1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:52.635877 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-70334e62-242e-4f29-9f04-40704f20f6d1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:52.641927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-70334e62-242e-4f29-9f04-40704f20f6d1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:52.642376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-70334e62-242e-4f29-9f04-40704f20f6d1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:52.643247 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-70334e62-242e-4f29-9f04-40704f20f6d1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:52.643679 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-70334e62-242e-4f29-9f04-40704f20f6d1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:52.790179 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-70334e62-242e-4f29-9f04-40704f20f6d1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:52.798294 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-70334e62-242e-4f29-9f04-40704f20f6d1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1574 microversion: 2.1 time: 0.167610 Dec 18 03:21:52.798870 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 531/1030] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:52 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:53.616309 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b3bb1a93-ca5a-495b-9a44-a4200576f84c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:53.616951 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b3bb1a93-ca5a-495b-9a44-a4200576f84c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:53.623903 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3bb1a93-ca5a-495b-9a44-a4200576f84c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:53.624385 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3bb1a93-ca5a-495b-9a44-a4200576f84c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:53.625172 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3bb1a93-ca5a-495b-9a44-a4200576f84c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:53.625607 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3bb1a93-ca5a-495b-9a44-a4200576f84c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:53.757973 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-b3bb1a93-ca5a-495b-9a44-a4200576f84c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:53.766043 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b3bb1a93-ca5a-495b-9a44-a4200576f84c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1668 microversion: 2.1 time: 0.153610 Dec 18 03:21:53.766619 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 500/1031] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:53 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:53.815256 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4d2cfca8-550a-43bb-adc0-173317a2804f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:53.815866 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4d2cfca8-550a-43bb-adc0-173317a2804f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:53.822129 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4d2cfca8-550a-43bb-adc0-173317a2804f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:53.822569 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4d2cfca8-550a-43bb-adc0-173317a2804f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:53.823329 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4d2cfca8-550a-43bb-adc0-173317a2804f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:53.823754 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4d2cfca8-550a-43bb-adc0-173317a2804f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:53.952938 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-4d2cfca8-550a-43bb-adc0-173317a2804f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:53.960337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4d2cfca8-550a-43bb-adc0-173317a2804f tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1574 microversion: 2.1 time: 0.148607 Dec 18 03:21:53.960838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 532/1032] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:53 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:54.976553 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3e05d858-2ae6-4e70-9269-5de305542ee7 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:54.977184 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3e05d858-2ae6-4e70-9269-5de305542ee7 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:54.983814 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3e05d858-2ae6-4e70-9269-5de305542ee7 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:54.984260 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3e05d858-2ae6-4e70-9269-5de305542ee7 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:54.985080 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3e05d858-2ae6-4e70-9269-5de305542ee7 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:54.985537 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3e05d858-2ae6-4e70-9269-5de305542ee7 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:55.119031 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3e05d858-2ae6-4e70-9269-5de305542ee7 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:55.126778 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3e05d858-2ae6-4e70-9269-5de305542ee7 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1574 microversion: 2.1 time: 0.153854 Dec 18 03:21:55.127338 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 501/1033] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:54 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:56.143395 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6b6cc886-aef3-4128-b57b-b2fd44e003b1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:21:56.144011 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-6b6cc886-aef3-4128-b57b-b2fd44e003b1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:21:56.150263 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6b6cc886-aef3-4128-b57b-b2fd44e003b1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:56.150712 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6b6cc886-aef3-4128-b57b-b2fd44e003b1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:56.151479 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6b6cc886-aef3-4128-b57b-b2fd44e003b1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:56.151910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-6b6cc886-aef3-4128-b57b-b2fd44e003b1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:56.290512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-6b6cc886-aef3-4128-b57b-b2fd44e003b1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:21:56.297834 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6b6cc886-aef3-4128-b57b-b2fd44e003b1 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1561 microversion: 2.1 time: 0.158035 Dec 18 03:21:56.298415 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 533/1034] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:21:56 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:21:57.824304 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-863a4c3d-ff73-482a-b8ba-db39c3268ddb req-d8659b97-18b8-46de-8208-8e404b3da8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d244df22-21b2-40e5-972f-e6678258f781", "name": "network-vif-plugged", "status": "completed", "tag": "60bc3098-1a05-43da-aad1-0105b3137056"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:21:57.826667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:21:57.826667 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:21:57.834630 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-863a4c3d-ff73-482a-b8ba-db39c3268ddb req-d8659b97-18b8-46de-8208-8e404b3da8cb service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:21:57.835082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-863a4c3d-ff73-482a-b8ba-db39c3268ddb req-d8659b97-18b8-46de-8208-8e404b3da8cb service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:21:57.848735 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-863a4c3d-ff73-482a-b8ba-db39c3268ddb req-d8659b97-18b8-46de-8208-8e404b3da8cb service nova] Creating event network-vif-plugged:60bc3098-1a05-43da-aad1-0105b3137056 for instance d244df22-21b2-40e5-972f-e6678258f781 on hv-cinder-81803 Dec 18 03:21:57.853835 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-863a4c3d-ff73-482a-b8ba-db39c3268ddb req-d8659b97-18b8-46de-8208-8e404b3da8cb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033115 Dec 18 03:21:57.854624 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 502/1035] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:21:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:22:19.349095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:22:19.349834 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: Sat Dec 18 03:22:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 03:22:25.221115 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-afc7fc08-682a-4f23-b14b-615c44b74479 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:25.221683 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-afc7fc08-682a-4f23-b14b-615c44b74479 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:25.223544 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-825a7263-b693-4f3e-af32-47a7b25b0f0b req-4002a969-f148-4835-8ae6-8bca0f7bfbeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b643a05-8259-4a3b-a274-23652c18a879", "tag": "bc34ae5c-b28d-4f84-bfcf-c60e402449ba"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:25.225226 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:22:25.225226 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:22:25.228994 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-afc7fc08-682a-4f23-b14b-615c44b74479 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:25.229150 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-afc7fc08-682a-4f23-b14b-615c44b74479 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:25.230220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-afc7fc08-682a-4f23-b14b-615c44b74479 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:25.230776 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-afc7fc08-682a-4f23-b14b-615c44b74479 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:25.235266 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-825a7263-b693-4f3e-af32-47a7b25b0f0b req-4002a969-f148-4835-8ae6-8bca0f7bfbeb service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:25.235780 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-825a7263-b693-4f3e-af32-47a7b25b0f0b req-4002a969-f148-4835-8ae6-8bca0f7bfbeb service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:25.247382 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-825a7263-b693-4f3e-af32-47a7b25b0f0b req-4002a969-f148-4835-8ae6-8bca0f7bfbeb service nova] Creating event network-changed:bc34ae5c-b28d-4f84-bfcf-c60e402449ba for instance 4b643a05-8259-4a3b-a274-23652c18a879 on hv-cinder-81803 Dec 18 03:22:25.252782 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-825a7263-b693-4f3e-af32-47a7b25b0f0b req-4002a969-f148-4835-8ae6-8bca0f7bfbeb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033737 Dec 18 03:22:25.253961 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 503/1036] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:22:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:22:25.259829 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-afc7fc08-682a-4f23-b14b-615c44b74479 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:22:25.354199 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-afc7fc08-682a-4f23-b14b-615c44b74479 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "DELETE /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 204 len: 0 microversion: 2.1 time: 0.138210 Dec 18 03:22:25.359272 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 534/1037] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:22:25 2021] DELETE /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:22:25.366052 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-761841fe-8978-4c69-b9b6-899085c82447 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:25.367385 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-761841fe-8978-4c69-b9b6-899085c82447 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:25.378389 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-761841fe-8978-4c69-b9b6-899085c82447 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:25.379166 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-761841fe-8978-4c69-b9b6-899085c82447 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:25.380654 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-761841fe-8978-4c69-b9b6-899085c82447 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:25.381382 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-761841fe-8978-4c69-b9b6-899085c82447 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:25.647926 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-761841fe-8978-4c69-b9b6-899085c82447 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:25.656034 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-761841fe-8978-4c69-b9b6-899085c82447 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1576 microversion: 2.1 time: 0.294927 Dec 18 03:22:25.657119 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 504/1038] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:25 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1576 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:26.673635 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e4d032cf-32c7-42eb-a7ef-b12e6d0aaef6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:26.674346 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e4d032cf-32c7-42eb-a7ef-b12e6d0aaef6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:26.680620 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e4d032cf-32c7-42eb-a7ef-b12e6d0aaef6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:26.681063 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e4d032cf-32c7-42eb-a7ef-b12e6d0aaef6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:26.681868 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e4d032cf-32c7-42eb-a7ef-b12e6d0aaef6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:26.682299 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e4d032cf-32c7-42eb-a7ef-b12e6d0aaef6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:26.911669 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-e8c9c60c-8a32-4926-bc00-58cf56f8b0d3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:26.912644 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-e8c9c60c-8a32-4926-bc00-58cf56f8b0d3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:26.919647 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e8c9c60c-8a32-4926-bc00-58cf56f8b0d3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:26.920099 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e8c9c60c-8a32-4926-bc00-58cf56f8b0d3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:26.920885 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e8c9c60c-8a32-4926-bc00-58cf56f8b0d3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:26.921328 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-e8c9c60c-8a32-4926-bc00-58cf56f8b0d3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:26.932344 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-e4d032cf-32c7-42eb-a7ef-b12e6d0aaef6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:26.940231 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e4d032cf-32c7-42eb-a7ef-b12e6d0aaef6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1457 microversion: 2.1 time: 0.270665 Dec 18 03:22:26.940796 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 535/1039] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:26 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1457 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:26.951137 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-e8c9c60c-8a32-4926-bc00-58cf56f8b0d3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043124 Dec 18 03:22:26.951683 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 505/1040] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:22:26 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 03:22:27.006180 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2319c0ef-fa53-47c3-b3fe-6617096ff23b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:27.006676 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2319c0ef-fa53-47c3-b3fe-6617096ff23b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:27.013191 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2319c0ef-fa53-47c3-b3fe-6617096ff23b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:27.013663 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2319c0ef-fa53-47c3-b3fe-6617096ff23b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:27.014441 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2319c0ef-fa53-47c3-b3fe-6617096ff23b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:27.014873 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2319c0ef-fa53-47c3-b3fe-6617096ff23b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:27.039185 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2319c0ef-fa53-47c3-b3fe-6617096ff23b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:22:27.112532 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2319c0ef-fa53-47c3-b3fe-6617096ff23b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 204 len: 0 microversion: 2.1 time: 0.109680 Dec 18 03:22:27.113299 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 536/1041] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:22:27 2021] DELETE /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:22:27.122935 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d3272d10-383a-499f-8090-72538ae38ef7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:27.123537 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d3272d10-383a-499f-8090-72538ae38ef7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:27.129223 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d3272d10-383a-499f-8090-72538ae38ef7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:27.129705 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d3272d10-383a-499f-8090-72538ae38ef7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:27.130468 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d3272d10-383a-499f-8090-72538ae38ef7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:27.130893 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d3272d10-383a-499f-8090-72538ae38ef7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:27.257369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-d3272d10-383a-499f-8090-72538ae38ef7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:27.265088 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d3272d10-383a-499f-8090-72538ae38ef7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1674 microversion: 2.1 time: 0.147135 Dec 18 03:22:27.265674 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 506/1042] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:27 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:27.869752 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-6a42142f-049a-4283-a4da-54cfd31da981 req-b24fc962-b562-4545-84e0-c471fad98ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b643a05-8259-4a3b-a274-23652c18a879", "name": "network-vif-deleted", "tag": "bc34ae5c-b28d-4f84-bfcf-c60e402449ba"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:27.871485 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:22:27.871485 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:22:27.878962 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-6a42142f-049a-4283-a4da-54cfd31da981 req-b24fc962-b562-4545-84e0-c471fad98ff4 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:27.879407 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-6a42142f-049a-4283-a4da-54cfd31da981 req-b24fc962-b562-4545-84e0-c471fad98ff4 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:27.890904 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-6a42142f-049a-4283-a4da-54cfd31da981 req-b24fc962-b562-4545-84e0-c471fad98ff4 service nova] Creating event network-vif-deleted:bc34ae5c-b28d-4f84-bfcf-c60e402449ba for instance 4b643a05-8259-4a3b-a274-23652c18a879 on hv-cinder-81803 Dec 18 03:22:27.895707 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-6a42142f-049a-4283-a4da-54cfd31da981 req-b24fc962-b562-4545-84e0-c471fad98ff4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029881 Dec 18 03:22:27.896289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 537/1043] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:22:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:22:27.957612 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c152274e-7246-44bb-a1cc-a5d02ef15342 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:27.958255 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c152274e-7246-44bb-a1cc-a5d02ef15342 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:27.964554 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c152274e-7246-44bb-a1cc-a5d02ef15342 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:27.965100 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c152274e-7246-44bb-a1cc-a5d02ef15342 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:27.966644 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c152274e-7246-44bb-a1cc-a5d02ef15342 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:27.967078 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c152274e-7246-44bb-a1cc-a5d02ef15342 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:28.025195 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c152274e-7246-44bb-a1cc-a5d02ef15342 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:28.033639 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c152274e-7246-44bb-a1cc-a5d02ef15342 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 200 len: 1224 microversion: 2.1 time: 0.079700 Dec 18 03:22:28.034203 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 507/1044] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:27 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:28.283708 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0b995de6-a3c8-4dc9-ace8-f5d4cce165d9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:28.284518 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0b995de6-a3c8-4dc9-ace8-f5d4cce165d9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:28.291316 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0b995de6-a3c8-4dc9-ace8-f5d4cce165d9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:28.291672 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0b995de6-a3c8-4dc9-ace8-f5d4cce165d9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:28.292519 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0b995de6-a3c8-4dc9-ace8-f5d4cce165d9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:28.293081 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0b995de6-a3c8-4dc9-ace8-f5d4cce165d9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:28.423454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-0b995de6-a3c8-4dc9-ace8-f5d4cce165d9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:28.430788 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0b995de6-a3c8-4dc9-ace8-f5d4cce165d9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1674 microversion: 2.1 time: 0.151963 Dec 18 03:22:28.431348 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 538/1045] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:28 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:29.049561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0db97ea5-2d9f-4cdb-bd9a-be3ba42e2639 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:29.050249 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0db97ea5-2d9f-4cdb-bd9a-be3ba42e2639 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 4b643a05-8259-4a3b-a274-23652c18a879] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:29.056372 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0db97ea5-2d9f-4cdb-bd9a-be3ba42e2639 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:29.056815 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0db97ea5-2d9f-4cdb-bd9a-be3ba42e2639 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:29.057586 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0db97ea5-2d9f-4cdb-bd9a-be3ba42e2639 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:29.058041 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0db97ea5-2d9f-4cdb-bd9a-be3ba42e2639 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:29.070896 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-0db97ea5-2d9f-4cdb-bd9a-be3ba42e2639 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] HTTP exception thrown: Instance 4b643a05-8259-4a3b-a274-23652c18a879 could not be found. Dec 18 03:22:29.071463 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0db97ea5-2d9f-4cdb-bd9a-be3ba42e2639 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Returning 404 to user: Instance 4b643a05-8259-4a3b-a274-23652c18a879 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:22:29.072252 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0db97ea5-2d9f-4cdb-bd9a-be3ba42e2639 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879" status: 404 len: 111 microversion: 2.1 time: 0.026332 Dec 18 03:22:29.072749 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 508/1046] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:29 2021] GET /compute/v2.1/servers/4b643a05-8259-4a3b-a274-23652c18a879 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:22:29.448361 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-65890475-af09-493a-bdca-a0d4ddd8d6c7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:29.448979 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-65890475-af09-493a-bdca-a0d4ddd8d6c7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:29.455385 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65890475-af09-493a-bdca-a0d4ddd8d6c7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:29.455838 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65890475-af09-493a-bdca-a0d4ddd8d6c7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:29.456615 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65890475-af09-493a-bdca-a0d4ddd8d6c7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:29.457044 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-65890475-af09-493a-bdca-a0d4ddd8d6c7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:29.590426 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-65890475-af09-493a-bdca-a0d4ddd8d6c7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:29.597749 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-65890475-af09-493a-bdca-a0d4ddd8d6c7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1674 microversion: 2.1 time: 0.153326 Dec 18 03:22:29.598314 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 539/1047] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:29 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:30.423305 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-7590d64b-2c8d-4753-8785-b750edb4db77 req-f0e21abb-f8ac-4fe8-961f-7e5782aed4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d21616b-5525-492c-a7ac-85e63612742a", "name": "network-vif-deleted", "tag": "1ec58379-1ff2-4be3-a202-e4a865f02b1a"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:30.424829 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:22:30.424829 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:22:30.433267 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-7590d64b-2c8d-4753-8785-b750edb4db77 req-f0e21abb-f8ac-4fe8-961f-7e5782aed4dd service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:30.433838 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-7590d64b-2c8d-4753-8785-b750edb4db77 req-f0e21abb-f8ac-4fe8-961f-7e5782aed4dd service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:30.446039 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-7590d64b-2c8d-4753-8785-b750edb4db77 req-f0e21abb-f8ac-4fe8-961f-7e5782aed4dd service nova] Creating event network-vif-deleted:1ec58379-1ff2-4be3-a202-e4a865f02b1a for instance 1d21616b-5525-492c-a7ac-85e63612742a on hv-cinder-81803 Dec 18 03:22:30.451129 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-7590d64b-2c8d-4753-8785-b750edb4db77 req-f0e21abb-f8ac-4fe8-961f-7e5782aed4dd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031358 Dec 18 03:22:30.454613 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 509/1048] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:22:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:22:30.617822 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:30.619192 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:30.629351 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:30.630196 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:30.631364 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:30.632034 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:30.673369 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:30.673940 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:30.674456 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.objects.instance [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lazy-loading 'fault' on Instance uuid 1d21616b-5525-492c-a7ac-85e63612742a {{(pid=116001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:22:30.714244 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:30.722793 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7f5fa403-381d-48c2-9053-e27939dbdd61 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 200 len: 1328 microversion: 2.1 time: 0.111342 Dec 18 03:22:30.723453 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 540/1049] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:30 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 18 03:22:31.741419 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-251a9a4e-21dd-4194-be01-0964f5dfae09 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:31.742059 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-251a9a4e-21dd-4194-be01-0964f5dfae09 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:31.748583 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-251a9a4e-21dd-4194-be01-0964f5dfae09 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:31.749030 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-251a9a4e-21dd-4194-be01-0964f5dfae09 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:31.749859 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-251a9a4e-21dd-4194-be01-0964f5dfae09 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:31.750290 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-251a9a4e-21dd-4194-be01-0964f5dfae09 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:31.764453 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-251a9a4e-21dd-4194-be01-0964f5dfae09 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] HTTP exception thrown: Instance 1d21616b-5525-492c-a7ac-85e63612742a could not be found. Dec 18 03:22:31.765077 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-251a9a4e-21dd-4194-be01-0964f5dfae09 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Returning 404 to user: Instance 1d21616b-5525-492c-a7ac-85e63612742a could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:22:31.765923 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-251a9a4e-21dd-4194-be01-0964f5dfae09 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 404 len: 111 microversion: 2.1 time: 0.029213 Dec 18 03:22:31.766486 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 510/1050] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:31 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:22:31.774672 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-563e355b-24e0-49bc-ac54-350c3d579cb2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '.version_select at 0x7fad26b27a60>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:31.796696 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-563e355b-24e0-49bc-ac54-350c3d579cb2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087650046" status: 202 len: 0 microversion: 2.1 time: 0.025540 Dec 18 03:22:31.797265 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 541/1051] 10.222.0.24 () {58 vars in 1220 bytes} [Sat Dec 18 03:22:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087650046 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:22:32.415164 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cf672a83-d3ac-4265-93e2-cf5cc6aa099e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:32.415753 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cf672a83-d3ac-4265-93e2-cf5cc6aa099e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:32.430174 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cf672a83-d3ac-4265-93e2-cf5cc6aa099e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:32.430702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cf672a83-d3ac-4265-93e2-cf5cc6aa099e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:32.431501 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cf672a83-d3ac-4265-93e2-cf5cc6aa099e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:32.431942 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cf672a83-d3ac-4265-93e2-cf5cc6aa099e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:32.451210 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-974e5fc6-1100-40d3-b21d-a2ad9f0d0790 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'create', calling method: .version_select at 0x7fad26aa6a60>, body: {"keypair": {"name": "tempest-keypair-1537701310"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:32.462104 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cf672a83-d3ac-4265-93e2-cf5cc6aa099e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Going to try to terminate instance {{(pid=116000) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:22:32.467231 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-974e5fc6-1100-40d3-b21d-a2ad9f0d0790 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'key_pairs'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:22:32.471386 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-974e5fc6-1100-40d3-b21d-a2ad9f0d0790 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for user 3c719df3f54e442790c9a6c9d1e687e9 and project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'key_pairs'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:22:32.546364 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cf672a83-d3ac-4265-93e2-cf5cc6aa099e tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 204 len: 0 microversion: 2.1 time: 0.134587 Dec 18 03:22:32.547372 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 511/1052] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:22:32 2021] DELETE /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:22:32.554325 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-089f2bae-ea88-4736-a67a-a1f0d74a933c req-59557928-75cf-46c2-9cfc-f030a87d79fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ae8d2c-858b-465e-8d30-9641c8bed187", "tag": "66d77aea-4360-4b4d-9dff-ae5b34ea1557"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:32.555951 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:22:32.555951 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:22:32.564622 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-089f2bae-ea88-4736-a67a-a1f0d74a933c req-59557928-75cf-46c2-9cfc-f030a87d79fd service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:32.565073 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-089f2bae-ea88-4736-a67a-a1f0d74a933c req-59557928-75cf-46c2-9cfc-f030a87d79fd service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:32.576512 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-089f2bae-ea88-4736-a67a-a1f0d74a933c req-59557928-75cf-46c2-9cfc-f030a87d79fd service nova] Creating event network-changed:66d77aea-4360-4b4d-9dff-ae5b34ea1557 for instance d5ae8d2c-858b-465e-8d30-9641c8bed187 on hv-cinder-81803 Dec 18 03:22:32.582144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-089f2bae-ea88-4736-a67a-a1f0d74a933c req-59557928-75cf-46c2-9cfc-f030a87d79fd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033267 Dec 18 03:22:32.585801 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 512/1053] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:22:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:22:32.591436 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c8e77be5-cce9-42e2-ad82-c7db43473155 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:32.592120 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c8e77be5-cce9-42e2-ad82-c7db43473155 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:32.598496 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8e77be5-cce9-42e2-ad82-c7db43473155 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:32.598940 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8e77be5-cce9-42e2-ad82-c7db43473155 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:32.599714 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8e77be5-cce9-42e2-ad82-c7db43473155 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:32.600145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c8e77be5-cce9-42e2-ad82-c7db43473155 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:32.649311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-974e5fc6-1100-40d3-b21d-a2ad9f0d0790 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'key_pairs'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:22:32.656271 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.quota [None req-974e5fc6-1100-40d3-b21d-a2ad9f0d0790 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for user 3c719df3f54e442790c9a6c9d1e687e9 and project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'key_pairs'} {{(pid=116001) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:22:32.670325 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-974e5fc6-1100-40d3-b21d-a2ad9f0d0790 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.224064 Dec 18 03:22:32.670918 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 542/1054] 10.222.0.24 () {60 vars in 1157 bytes} [Sat Dec 18 03:22:32 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:32.842175 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-c8e77be5-cce9-42e2-ad82-c7db43473155 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:32.851943 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c8e77be5-cce9-42e2-ad82-c7db43473155 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1576 microversion: 2.1 time: 0.264944 Dec 18 03:22:32.853841 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 513/1055] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:32 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1576 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:33.875419 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-92bc75d3-4625-41fc-b188-0caf81be73e3 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:33.875969 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-92bc75d3-4625-41fc-b188-0caf81be73e3 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:33.882261 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-92bc75d3-4625-41fc-b188-0caf81be73e3 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:33.882711 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-92bc75d3-4625-41fc-b188-0caf81be73e3 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:33.883483 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-92bc75d3-4625-41fc-b188-0caf81be73e3 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:33.883909 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-92bc75d3-4625-41fc-b188-0caf81be73e3 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:34.109690 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-92bc75d3-4625-41fc-b188-0caf81be73e3 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:34.117948 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-92bc75d3-4625-41fc-b188-0caf81be73e3 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1457 microversion: 2.1 time: 0.247019 Dec 18 03:22:34.118643 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 543/1056] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:33 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1457 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:34.210873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-689013767", "imageRef": "608d2120-20ee-4fe1-8fa9-a60fde86bc83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fda238b-cb83-4001-a89c-717f18485950"}], "security_groups": [{"name": "tempest-securitygroup--2044574749"}], "key_name": "tempest-keypair-1537701310", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:34.333974 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.network.neutron [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] validate_networks() for [('3fda238b-cb83-4001-a89c-717f18485950', None, None, None, None, None)] {{(pid=116000) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 18 03:22:34.939029 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Flavor limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 18 03:22:34.939549 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Image limits 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 18 03:22:34.940183 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Flavor pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 18 03:22:34.940658 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Image pref 0:0:0 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 18 03:22:34.941134 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.virt.hardware [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 18 03:22:34.950594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:34.951308 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:34.952126 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:34.952561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:34.968877 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 18 03:22:34.980552 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.quota [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Getting quotas for user 3c719df3f54e442790c9a6c9d1e687e9 and project d5ef52b4e7164c93988c7ca58686d98f. Resources: {'ram', 'cores', 'instances'} {{(pid=116000) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 18 03:22:34.993387 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Going to run 1 instances... {{(pid=116000) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 18 03:22:34.995781 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='608d2120-20ee-4fe1-8fa9-a60fde86bc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 18 03:22:35.030712 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-ffcc78dd-231c-47d0-88d7-b3d28256d891 req-c268b86c-4e37-406b-876b-dfcb4d5b4c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ae8d2c-858b-465e-8d30-9641c8bed187", "name": "network-vif-deleted", "tag": "66d77aea-4360-4b4d-9dff-ae5b34ea1557"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:35.032948 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:22:35.032948 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:22:35.041217 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-ffcc78dd-231c-47d0-88d7-b3d28256d891 req-c268b86c-4e37-406b-876b-dfcb4d5b4c01 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:35.041813 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-ffcc78dd-231c-47d0-88d7-b3d28256d891 req-c268b86c-4e37-406b-876b-dfcb4d5b4c01 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:35.048817 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b3ba09ce-a0ed-4704-85a5-d69c56d8a046 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.841855 Dec 18 03:22:35.049466 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 514/1057] 10.222.0.24 () {60 vars in 1146 bytes} [Sat Dec 18 03:22:34 2021] POST /compute/v2.1/servers => generated 402 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 18 03:22:35.054226 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-ffcc78dd-231c-47d0-88d7-b3d28256d891 req-c268b86c-4e37-406b-876b-dfcb4d5b4c01 service nova] Creating event network-vif-deleted:66d77aea-4360-4b4d-9dff-ae5b34ea1557 for instance d5ae8d2c-858b-465e-8d30-9641c8bed187 on hv-cinder-81803 Dec 18 03:22:35.060442 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-ffcc78dd-231c-47d0-88d7-b3d28256d891 req-c268b86c-4e37-406b-876b-dfcb4d5b4c01 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033792 Dec 18 03:22:35.061317 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 544/1058] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:22:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:22:35.063572 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-1734b38f-77af-46f8-9d1d-863d27a89ba1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:35.064187 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-1734b38f-77af-46f8-9d1d-863d27a89ba1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:35.120369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-1734b38f-77af-46f8-9d1d-863d27a89ba1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:35.127124 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-1734b38f-77af-46f8-9d1d-863d27a89ba1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1237 microversion: 2.1 time: 0.068247 Dec 18 03:22:35.127704 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 515/1059] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:35 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:35.135863 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-758d9e3e-6019-484a-8588-0e10a2db0861 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:35.136559 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-758d9e3e-6019-484a-8588-0e10a2db0861 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:35.143715 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-758d9e3e-6019-484a-8588-0e10a2db0861 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:35.144154 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-758d9e3e-6019-484a-8588-0e10a2db0861 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:35.145068 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-758d9e3e-6019-484a-8588-0e10a2db0861 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:35.145531 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-758d9e3e-6019-484a-8588-0e10a2db0861 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:35.209561 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-758d9e3e-6019-484a-8588-0e10a2db0861 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2d51b351b44cdfb136d754ffdf3f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f34416462043419f27fc97d17ab2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:35.217934 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-758d9e3e-6019-484a-8588-0e10a2db0861 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 200 len: 1224 microversion: 2.1 time: 0.086454 Dec 18 03:22:35.218543 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 545/1060] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:35 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:36.143570 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-190f62be-ef6c-446f-9e82-4de7d2c673fc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:36.144304 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-190f62be-ef6c-446f-9e82-4de7d2c673fc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:36.151930 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-190f62be-ef6c-446f-9e82-4de7d2c673fc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:36.153012 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-190f62be-ef6c-446f-9e82-4de7d2c673fc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:36.153868 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-190f62be-ef6c-446f-9e82-4de7d2c673fc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:36.154308 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-190f62be-ef6c-446f-9e82-4de7d2c673fc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:36.216141 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-190f62be-ef6c-446f-9e82-4de7d2c673fc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:36.224019 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-190f62be-ef6c-446f-9e82-4de7d2c673fc tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1297 microversion: 2.1 time: 0.083972 Dec 18 03:22:36.233938 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 516/1061] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:36 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:36.239745 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-88cab717-411a-4ff1-8c4a-9eb1513773c0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:36.240431 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-88cab717-411a-4ff1-8c4a-9eb1513773c0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: d5ae8d2c-858b-465e-8d30-9641c8bed187] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:36.247752 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-88cab717-411a-4ff1-8c4a-9eb1513773c0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:36.248406 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-88cab717-411a-4ff1-8c4a-9eb1513773c0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:36.249405 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-88cab717-411a-4ff1-8c4a-9eb1513773c0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:36.249875 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-88cab717-411a-4ff1-8c4a-9eb1513773c0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:36.264720 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-88cab717-411a-4ff1-8c4a-9eb1513773c0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] HTTP exception thrown: Instance d5ae8d2c-858b-465e-8d30-9641c8bed187 could not be found. Dec 18 03:22:36.265314 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-88cab717-411a-4ff1-8c4a-9eb1513773c0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Returning 404 to user: Instance d5ae8d2c-858b-465e-8d30-9641c8bed187 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:22:36.266188 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-88cab717-411a-4ff1-8c4a-9eb1513773c0 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187" status: 404 len: 111 microversion: 2.1 time: 0.030479 Dec 18 03:22:36.267043 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 546/1062] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:36 2021] GET /compute/v2.1/servers/d5ae8d2c-858b-465e-8d30-9641c8bed187 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:22:36.977393 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5755c5e7-9b25-43db-8506-a06eddb8e3d1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:36.978000 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5755c5e7-9b25-43db-8506-a06eddb8e3d1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:36.984446 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5755c5e7-9b25-43db-8506-a06eddb8e3d1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:36.984892 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5755c5e7-9b25-43db-8506-a06eddb8e3d1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:36.985739 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5755c5e7-9b25-43db-8506-a06eddb8e3d1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:36.986195 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5755c5e7-9b25-43db-8506-a06eddb8e3d1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:36.999814 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-5755c5e7-9b25-43db-8506-a06eddb8e3d1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] HTTP exception thrown: Instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 could not be found. Dec 18 03:22:37.000558 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5755c5e7-9b25-43db-8506-a06eddb8e3d1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Returning 404 to user: Instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:22:37.001669 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5755c5e7-9b25-43db-8506-a06eddb8e3d1 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 404 len: 111 microversion: 2.1 time: 0.028272 Dec 18 03:22:37.002317 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 517/1063] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:22:36 2021] DELETE /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:22:37.010311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1f6671d5-4771-4ebf-8889-bab0b1e9b887 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:37.010975 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1f6671d5-4771-4ebf-8889-bab0b1e9b887 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] [instance: 9f9e593b-0924-4c44-b1f2-e978a0a72025] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:37.017512 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1f6671d5-4771-4ebf-8889-bab0b1e9b887 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:37.017994 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1f6671d5-4771-4ebf-8889-bab0b1e9b887 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:37.018771 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1f6671d5-4771-4ebf-8889-bab0b1e9b887 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:37.019201 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1f6671d5-4771-4ebf-8889-bab0b1e9b887 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:37.032946 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-1f6671d5-4771-4ebf-8889-bab0b1e9b887 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] HTTP exception thrown: Instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 could not be found. Dec 18 03:22:37.033523 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1f6671d5-4771-4ebf-8889-bab0b1e9b887 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Returning 404 to user: Instance 9f9e593b-0924-4c44-b1f2-e978a0a72025 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:22:37.034364 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1f6671d5-4771-4ebf-8889-bab0b1e9b887 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025" status: 404 len: 111 microversion: 2.1 time: 0.027757 Dec 18 03:22:37.034898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 547/1064] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:37 2021] GET /compute/v2.1/servers/9f9e593b-0924-4c44-b1f2-e978a0a72025 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:22:37.241544 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-19530c7c-fc54-4195-a666-44a0bfb9d976 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:37.242893 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-19530c7c-fc54-4195-a666-44a0bfb9d976 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:37.251531 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19530c7c-fc54-4195-a666-44a0bfb9d976 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:37.252122 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19530c7c-fc54-4195-a666-44a0bfb9d976 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:37.253022 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19530c7c-fc54-4195-a666-44a0bfb9d976 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:37.253451 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19530c7c-fc54-4195-a666-44a0bfb9d976 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:37.523668 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-19530c7c-fc54-4195-a666-44a0bfb9d976 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:37.530870 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-19530c7c-fc54-4195-a666-44a0bfb9d976 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1363 microversion: 2.1 time: 0.293202 Dec 18 03:22:37.531438 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 518/1065] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:37 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:37.951610 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-9404dd48-43ad-43ab-8272-7fd8e967f369 req-55a1f041-8365-4737-903b-a8cc39f4cce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a4f5c1-5640-4b05-8d47-ced994ed06b6", "tag": "7c901558-680c-49ed-b1ad-c108605f42fa"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:37.953790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:22:37.953790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:22:37.961974 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-9404dd48-43ad-43ab-8272-7fd8e967f369 req-55a1f041-8365-4737-903b-a8cc39f4cce2 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:37.962472 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-9404dd48-43ad-43ab-8272-7fd8e967f369 req-55a1f041-8365-4737-903b-a8cc39f4cce2 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:37.984009 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-9404dd48-43ad-43ab-8272-7fd8e967f369 req-55a1f041-8365-4737-903b-a8cc39f4cce2 service nova] Creating event network-changed:7c901558-680c-49ed-b1ad-c108605f42fa for instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 on hv-cinder-81803 Dec 18 03:22:37.988900 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-9404dd48-43ad-43ab-8272-7fd8e967f369 req-55a1f041-8365-4737-903b-a8cc39f4cce2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040870 Dec 18 03:22:37.989446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 548/1066] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:22:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:22:38.547243 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3575090d-1c3e-431c-b49d-944e094e6dca tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:38.547871 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3575090d-1c3e-431c-b49d-944e094e6dca tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:38.554275 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3575090d-1c3e-431c-b49d-944e094e6dca tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:38.554730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3575090d-1c3e-431c-b49d-944e094e6dca tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:38.555547 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3575090d-1c3e-431c-b49d-944e094e6dca tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:38.555988 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3575090d-1c3e-431c-b49d-944e094e6dca tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:38.780070 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-00e9b1a8-219e-492a-a92a-dc23db824ce6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] Calling method '.version_select at 0x7fad26ae03a0>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:38.798482 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-00e9b1a8-219e-492a-a92a-dc23db824ce6 tempest-TestVolumeBootPattern-1832453000 tempest-TestVolumeBootPattern-1832453000-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-412012440" status: 202 len: 0 microversion: 2.1 time: 0.022306 Dec 18 03:22:38.799599 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 549/1067] 10.222.0.24 () {58 vars in 1259 bytes} [Sat Dec 18 03:22:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-412012440 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:22:38.807128 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-3575090d-1c3e-431c-b49d-944e094e6dca tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:38.818915 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3575090d-1c3e-431c-b49d-944e094e6dca tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1363 microversion: 2.1 time: 0.275277 Dec 18 03:22:38.819491 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 519/1068] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:38 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:39.838717 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-dff48d6b-5053-43e1-b731-16718fbd36d4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:39.839343 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-dff48d6b-5053-43e1-b731-16718fbd36d4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:39.845187 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dff48d6b-5053-43e1-b731-16718fbd36d4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:39.845641 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dff48d6b-5053-43e1-b731-16718fbd36d4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:39.846421 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dff48d6b-5053-43e1-b731-16718fbd36d4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:39.846846 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-dff48d6b-5053-43e1-b731-16718fbd36d4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:39.978147 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-dff48d6b-5053-43e1-b731-16718fbd36d4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:39.986784 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-dff48d6b-5053-43e1-b731-16718fbd36d4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1363 microversion: 2.1 time: 0.152315 Dec 18 03:22:39.987345 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 550/1069] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:39 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:41.003542 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-58be2ba3-6859-4464-8434-1be14a35d3a2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:41.006843 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-58be2ba3-6859-4464-8434-1be14a35d3a2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:41.015349 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-58be2ba3-6859-4464-8434-1be14a35d3a2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:41.016061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-58be2ba3-6859-4464-8434-1be14a35d3a2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:41.016852 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-58be2ba3-6859-4464-8434-1be14a35d3a2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:41.017440 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-58be2ba3-6859-4464-8434-1be14a35d3a2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:41.631290 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-58be2ba3-6859-4464-8434-1be14a35d3a2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:41.638703 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-58be2ba3-6859-4464-8434-1be14a35d3a2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1363 microversion: 2.1 time: 0.638833 Dec 18 03:22:41.639267 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 520/1070] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:40 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1363 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:42.655750 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b7ed216d-1cff-4285-9a75-e68e51dbc59c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:42.656311 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b7ed216d-1cff-4285-9a75-e68e51dbc59c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:42.662619 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7ed216d-1cff-4285-9a75-e68e51dbc59c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:42.663171 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7ed216d-1cff-4285-9a75-e68e51dbc59c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:42.664016 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7ed216d-1cff-4285-9a75-e68e51dbc59c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:42.664534 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7ed216d-1cff-4285-9a75-e68e51dbc59c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:43.096943 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b7ed216d-1cff-4285-9a75-e68e51dbc59c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:43.104164 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b7ed216d-1cff-4285-9a75-e68e51dbc59c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1363 microversion: 2.1 time: 0.452661 Dec 18 03:22:43.104729 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 551/1071] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:42 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:44.070437 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-9ea2cdcf-a518-4eee-a2ed-5055b6f0ca82 req-0b4c0864-57fe-445a-af78-2534ca9aea10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a4f5c1-5640-4b05-8d47-ced994ed06b6", "name": "network-vif-plugged", "status": "completed", "tag": "7c901558-680c-49ed-b1ad-c108605f42fa"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:44.072758 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:22:44.072758 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:22:44.080651 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-9ea2cdcf-a518-4eee-a2ed-5055b6f0ca82 req-0b4c0864-57fe-445a-af78-2534ca9aea10 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:44.081070 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-9ea2cdcf-a518-4eee-a2ed-5055b6f0ca82 req-0b4c0864-57fe-445a-af78-2534ca9aea10 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:44.092895 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-9ea2cdcf-a518-4eee-a2ed-5055b6f0ca82 req-0b4c0864-57fe-445a-af78-2534ca9aea10 service nova] Creating event network-vif-plugged:7c901558-680c-49ed-b1ad-c108605f42fa for instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 on hv-cinder-81803 Dec 18 03:22:44.097808 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-9ea2cdcf-a518-4eee-a2ed-5055b6f0ca82 req-0b4c0864-57fe-445a-af78-2534ca9aea10 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030894 Dec 18 03:22:44.098398 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 521/1072] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:22:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:22:44.124321 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-23ced31d-391c-493c-9dc7-7c7f5c5f10e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:44.125541 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-23ced31d-391c-493c-9dc7-7c7f5c5f10e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:44.132114 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23ced31d-391c-493c-9dc7-7c7f5c5f10e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:44.132790 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23ced31d-391c-493c-9dc7-7c7f5c5f10e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:44.144906 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23ced31d-391c-493c-9dc7-7c7f5c5f10e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:44.145378 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-23ced31d-391c-493c-9dc7-7c7f5c5f10e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:44.298618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-23ced31d-391c-493c-9dc7-7c7f5c5f10e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:44.312051 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-23ced31d-391c-493c-9dc7-7c7f5c5f10e0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1363 microversion: 2.1 time: 0.192024 Dec 18 03:22:44.314120 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 552/1073] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:44 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:45.331316 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a969ad40-0ea6-49cc-a62f-43f6a37fe326 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:45.332873 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a969ad40-0ea6-49cc-a62f-43f6a37fe326 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:45.339730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a969ad40-0ea6-49cc-a62f-43f6a37fe326 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:45.340354 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a969ad40-0ea6-49cc-a62f-43f6a37fe326 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:45.341145 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a969ad40-0ea6-49cc-a62f-43f6a37fe326 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:45.341578 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a969ad40-0ea6-49cc-a62f-43f6a37fe326 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:45.565303 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-a969ad40-0ea6-49cc-a62f-43f6a37fe326 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:45.572821 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a969ad40-0ea6-49cc-a62f-43f6a37fe326 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1363 microversion: 2.1 time: 0.245413 Dec 18 03:22:45.574439 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 522/1074] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:45 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:46.591814 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-cd510aa7-cb91-4f25-b23c-ab6e086a1200 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:46.592382 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-cd510aa7-cb91-4f25-b23c-ab6e086a1200 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:46.598413 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cd510aa7-cb91-4f25-b23c-ab6e086a1200 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:46.598861 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cd510aa7-cb91-4f25-b23c-ab6e086a1200 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:46.599639 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cd510aa7-cb91-4f25-b23c-ab6e086a1200 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:46.600084 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-cd510aa7-cb91-4f25-b23c-ab6e086a1200 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:46.737379 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-cd510aa7-cb91-4f25-b23c-ab6e086a1200 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:22:46.744617 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-cd510aa7-cb91-4f25-b23c-ab6e086a1200 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1549 microversion: 2.1 time: 0.157360 Dec 18 03:22:46.745182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 553/1075] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:22:46 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:22:46.760966 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-cd02bfe0-2e7f-47b3-b068-95f2e25d92d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:22:46.762652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-cd02bfe0-2e7f-47b3-b068-95f2e25d92d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:46.768859 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cd02bfe0-2e7f-47b3-b068-95f2e25d92d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:46.769390 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cd02bfe0-2e7f-47b3-b068-95f2e25d92d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:46.770280 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cd02bfe0-2e7f-47b3-b068-95f2e25d92d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:46.770783 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-cd02bfe0-2e7f-47b3-b068-95f2e25d92d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:46.853934 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-cd02bfe0-2e7f-47b3-b068-95f2e25d92d8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096826 Dec 18 03:22:46.854657 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 523/1076] 10.222.0.24 () {58 vars in 1274 bytes} [Sat Dec 18 03:22:46 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:22:47.787164 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c058726b-6130-4275-9485-43421b184b2d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:47.788141 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c058726b-6130-4275-9485-43421b184b2d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:47.789382 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-27ce9907-3662-4329-b979-bad187e26ad5 req-1240f620-3195-4ad1-a5e4-a70a886197c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a4f5c1-5640-4b05-8d47-ced994ed06b6", "tag": "7c901558-680c-49ed-b1ad-c108605f42fa"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:47.790905 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:22:47.790905 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:22:47.795068 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c058726b-6130-4275-9485-43421b184b2d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:47.795625 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c058726b-6130-4275-9485-43421b184b2d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:47.796536 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c058726b-6130-4275-9485-43421b184b2d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:47.797047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c058726b-6130-4275-9485-43421b184b2d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:47.800286 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-27ce9907-3662-4329-b979-bad187e26ad5 req-1240f620-3195-4ad1-a5e4-a70a886197c8 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:47.800739 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-27ce9907-3662-4329-b979-bad187e26ad5 req-1240f620-3195-4ad1-a5e4-a70a886197c8 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:47.812334 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-27ce9907-3662-4329-b979-bad187e26ad5 req-1240f620-3195-4ad1-a5e4-a70a886197c8 service nova] Creating event network-changed:7c901558-680c-49ed-b1ad-c108605f42fa for instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 on hv-cinder-81803 Dec 18 03:22:47.817314 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-27ce9907-3662-4329-b979-bad187e26ad5 req-1240f620-3195-4ad1-a5e4-a70a886197c8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031530 Dec 18 03:22:47.817947 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 524/1077] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:22:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:22:47.898753 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c058726b-6130-4275-9485-43421b184b2d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 14 microversion: 2.1 time: 0.115087 Dec 18 03:22:47.899536 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 554/1078] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:47 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 03:22:48.911074 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a4d5bd44-b0d7-4577-897a-c1a761d00806 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:48.912053 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a4d5bd44-b0d7-4577-897a-c1a761d00806 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:48.918652 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a4d5bd44-b0d7-4577-897a-c1a761d00806 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:48.919088 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a4d5bd44-b0d7-4577-897a-c1a761d00806 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:48.919851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a4d5bd44-b0d7-4577-897a-c1a761d00806 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:48.920274 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a4d5bd44-b0d7-4577-897a-c1a761d00806 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:48.999024 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a4d5bd44-b0d7-4577-897a-c1a761d00806 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 14 microversion: 2.1 time: 0.092219 Dec 18 03:22:48.999644 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 525/1079] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:48 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:22:50.010336 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ce2ec011-5a35-48e3-9a6b-df3953ea430f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:50.011873 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ce2ec011-5a35-48e3-9a6b-df3953ea430f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:50.018914 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ce2ec011-5a35-48e3-9a6b-df3953ea430f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:50.019366 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ce2ec011-5a35-48e3-9a6b-df3953ea430f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:50.020146 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ce2ec011-5a35-48e3-9a6b-df3953ea430f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:50.020582 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ce2ec011-5a35-48e3-9a6b-df3953ea430f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:50.097978 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ce2ec011-5a35-48e3-9a6b-df3953ea430f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 14 microversion: 2.1 time: 0.091594 Dec 18 03:22:50.098574 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 555/1080] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:50 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:22:51.109675 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f7a99d2d-08f7-4638-9826-c8ab739d9b2c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:51.110665 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f7a99d2d-08f7-4638-9826-c8ab739d9b2c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:51.117740 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f7a99d2d-08f7-4638-9826-c8ab739d9b2c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:51.118181 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f7a99d2d-08f7-4638-9826-c8ab739d9b2c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:51.118946 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f7a99d2d-08f7-4638-9826-c8ab739d9b2c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:51.119371 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f7a99d2d-08f7-4638-9826-c8ab739d9b2c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:51.200075 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f7a99d2d-08f7-4638-9826-c8ab739d9b2c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 14 microversion: 2.1 time: 0.094784 Dec 18 03:22:51.200684 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 526/1081] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:51 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 18 03:22:52.211467 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f4173da5-53a4-4c0d-94a8-65d9ea6c24a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:52.212495 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f4173da5-53a4-4c0d-94a8-65d9ea6c24a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:52.220082 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f4173da5-53a4-4c0d-94a8-65d9ea6c24a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:52.220528 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f4173da5-53a4-4c0d-94a8-65d9ea6c24a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:52.221302 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f4173da5-53a4-4c0d-94a8-65d9ea6c24a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:52.221763 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f4173da5-53a4-4c0d-94a8-65d9ea6c24a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:52.312452 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f4173da5-53a4-4c0d-94a8-65d9ea6c24a6 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 14 microversion: 2.1 time: 0.104820 Dec 18 03:22:52.313073 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 556/1082] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:52 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:22:53.324178 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-63d898e7-856c-4c96-82c9-e19644c28d3b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:53.325174 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-63d898e7-856c-4c96-82c9-e19644c28d3b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:53.332045 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63d898e7-856c-4c96-82c9-e19644c28d3b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:53.332492 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63d898e7-856c-4c96-82c9-e19644c28d3b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:53.333260 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63d898e7-856c-4c96-82c9-e19644c28d3b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:53.333726 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63d898e7-856c-4c96-82c9-e19644c28d3b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:53.412890 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-63d898e7-856c-4c96-82c9-e19644c28d3b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 14 microversion: 2.1 time: 0.093087 Dec 18 03:22:53.413655 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 527/1083] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:53 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:22:54.424293 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-79a7a986-fd07-402a-ab1b-b0d1b46e2c77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:54.425339 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-79a7a986-fd07-402a-ab1b-b0d1b46e2c77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:54.432252 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-79a7a986-fd07-402a-ab1b-b0d1b46e2c77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:54.432701 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-79a7a986-fd07-402a-ab1b-b0d1b46e2c77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:54.434023 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-79a7a986-fd07-402a-ab1b-b0d1b46e2c77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:54.434453 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-79a7a986-fd07-402a-ab1b-b0d1b46e2c77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:54.515733 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-79a7a986-fd07-402a-ab1b-b0d1b46e2c77 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 14 microversion: 2.1 time: 0.095383 Dec 18 03:22:54.516333 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 557/1084] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:54 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:22:55.528055 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a9065aec-478c-487e-a3d2-15e0cc60c877 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:55.529052 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a9065aec-478c-487e-a3d2-15e0cc60c877 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:55.535910 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a9065aec-478c-487e-a3d2-15e0cc60c877 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:55.536359 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a9065aec-478c-487e-a3d2-15e0cc60c877 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:55.537125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a9065aec-478c-487e-a3d2-15e0cc60c877 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:55.537556 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a9065aec-478c-487e-a3d2-15e0cc60c877 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:55.625491 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a9065aec-478c-487e-a3d2-15e0cc60c877 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 14 microversion: 2.1 time: 0.101985 Dec 18 03:22:55.626147 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 528/1085] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:55 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:22:56.637609 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-c07f29c7-9d64-46b8-95ff-975c9edc9542 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:56.638554 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-c07f29c7-9d64-46b8-95ff-975c9edc9542 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:56.645308 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c07f29c7-9d64-46b8-95ff-975c9edc9542 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:56.645787 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c07f29c7-9d64-46b8-95ff-975c9edc9542 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:56.646558 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c07f29c7-9d64-46b8-95ff-975c9edc9542 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:56.646985 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-c07f29c7-9d64-46b8-95ff-975c9edc9542 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:56.733283 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-c07f29c7-9d64-46b8-95ff-975c9edc9542 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 14 microversion: 2.1 time: 0.100498 Dec 18 03:22:56.734129 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 558/1086] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:56 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:22:57.744553 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a8b4b9d1-2480-4f4d-836c-cc619ec1433f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:57.746283 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a8b4b9d1-2480-4f4d-836c-cc619ec1433f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:57.753122 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a8b4b9d1-2480-4f4d-836c-cc619ec1433f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:57.753581 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a8b4b9d1-2480-4f4d-836c-cc619ec1433f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:57.754387 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a8b4b9d1-2480-4f4d-836c-cc619ec1433f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:57.754883 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a8b4b9d1-2480-4f4d-836c-cc619ec1433f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:57.849161 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a8b4b9d1-2480-4f4d-836c-cc619ec1433f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 10744 microversion: 2.1 time: 0.108546 Dec 18 03:22:57.850130 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 529/1087] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:57 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 10744 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:22:58.861666 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ce0cd843-8510-4390-aa37-6756bfef4799 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:58.862674 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ce0cd843-8510-4390-aa37-6756bfef4799 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:58.869564 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ce0cd843-8510-4390-aa37-6756bfef4799 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:58.870044 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ce0cd843-8510-4390-aa37-6756bfef4799 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:58.870887 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ce0cd843-8510-4390-aa37-6756bfef4799 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:58.871324 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ce0cd843-8510-4390-aa37-6756bfef4799 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:58.965220 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ce0cd843-8510-4390-aa37-6756bfef4799 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 18056 microversion: 2.1 time: 0.107412 Dec 18 03:22:58.969005 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 559/1088] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:58 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 18056 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:22:59.976876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-2adfc934-de1f-49ef-9ac8-b0353d99d691 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:22:59.977907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-2adfc934-de1f-49ef-9ac8-b0353d99d691 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:22:59.985599 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2adfc934-de1f-49ef-9ac8-b0353d99d691 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:59.986072 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2adfc934-de1f-49ef-9ac8-b0353d99d691 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:22:59.986864 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2adfc934-de1f-49ef-9ac8-b0353d99d691 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:22:59.987300 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-2adfc934-de1f-49ef-9ac8-b0353d99d691 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:00.240799 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-2adfc934-de1f-49ef-9ac8-b0353d99d691 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 19342 microversion: 2.1 time: 0.267713 Dec 18 03:23:00.241321 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 530/1089] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:22:59 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 19342 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:01.252383 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4656290c-09a9-4c09-8ff6-29124c40db1f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:01.253396 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-4656290c-09a9-4c09-8ff6-29124c40db1f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:01.260337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4656290c-09a9-4c09-8ff6-29124c40db1f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:01.261454 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4656290c-09a9-4c09-8ff6-29124c40db1f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:01.262262 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4656290c-09a9-4c09-8ff6-29124c40db1f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:01.262696 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-4656290c-09a9-4c09-8ff6-29124c40db1f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:01.353050 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4656290c-09a9-4c09-8ff6-29124c40db1f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 21972 microversion: 2.1 time: 0.104588 Dec 18 03:23:01.353688 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 560/1090] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:01 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 21972 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:02.365153 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c0e29c98-2d65-4eb1-bcaf-2417d9095c23 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:02.366214 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c0e29c98-2d65-4eb1-bcaf-2417d9095c23 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:02.373480 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c0e29c98-2d65-4eb1-bcaf-2417d9095c23 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:02.373954 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c0e29c98-2d65-4eb1-bcaf-2417d9095c23 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:02.374726 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c0e29c98-2d65-4eb1-bcaf-2417d9095c23 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:02.375157 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c0e29c98-2d65-4eb1-bcaf-2417d9095c23 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:02.467516 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c0e29c98-2d65-4eb1-bcaf-2417d9095c23 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 23600 microversion: 2.1 time: 0.106194 Dec 18 03:23:02.468169 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 531/1091] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:02 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 23600 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:03.479476 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-05749890-75db-460f-813e-c9594db8587f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:03.480957 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-05749890-75db-460f-813e-c9594db8587f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:03.488308 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-05749890-75db-460f-813e-c9594db8587f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:03.488760 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-05749890-75db-460f-813e-c9594db8587f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:03.489573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-05749890-75db-460f-813e-c9594db8587f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:03.490032 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-05749890-75db-460f-813e-c9594db8587f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:03.583612 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-05749890-75db-460f-813e-c9594db8587f tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 25275 microversion: 2.1 time: 0.108031 Dec 18 03:23:03.584248 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 561/1092] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:03 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 25275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:04.595688 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3b0c134f-52aa-4d79-97ff-cac86c3cfcd4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:04.596719 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3b0c134f-52aa-4d79-97ff-cac86c3cfcd4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:04.603603 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3b0c134f-52aa-4d79-97ff-cac86c3cfcd4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:04.604079 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3b0c134f-52aa-4d79-97ff-cac86c3cfcd4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:04.605115 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3b0c134f-52aa-4d79-97ff-cac86c3cfcd4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:04.605561 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3b0c134f-52aa-4d79-97ff-cac86c3cfcd4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:04.702960 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3b0c134f-52aa-4d79-97ff-cac86c3cfcd4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 26778 microversion: 2.1 time: 0.111081 Dec 18 03:23:04.703483 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 532/1093] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:04 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 26778 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:05.715077 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1744dbde-94d7-437d-a437-b0450670ace0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:05.716647 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-1744dbde-94d7-437d-a437-b0450670ace0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:05.723551 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1744dbde-94d7-437d-a437-b0450670ace0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:05.724003 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1744dbde-94d7-437d-a437-b0450670ace0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:05.724779 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1744dbde-94d7-437d-a437-b0450670ace0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:05.725211 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-1744dbde-94d7-437d-a437-b0450670ace0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:05.827476 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1744dbde-94d7-437d-a437-b0450670ace0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 27779 microversion: 2.1 time: 0.116401 Dec 18 03:23:05.828338 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 562/1094] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:05 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 27779 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:06.839697 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-112e7462-180f-489d-9adc-eb1f316f39b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:06.840697 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-112e7462-180f-489d-9adc-eb1f316f39b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:06.847525 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-112e7462-180f-489d-9adc-eb1f316f39b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:06.847970 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-112e7462-180f-489d-9adc-eb1f316f39b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:06.848756 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-112e7462-180f-489d-9adc-eb1f316f39b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:06.849173 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-112e7462-180f-489d-9adc-eb1f316f39b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:06.939334 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-112e7462-180f-489d-9adc-eb1f316f39b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 28189 microversion: 2.1 time: 0.103590 Dec 18 03:23:06.939941 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 533/1095] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:06 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 28189 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:07.950613 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-e0f34b22-1cdd-454d-bf10-261c56036bdf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:07.951641 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-e0f34b22-1cdd-454d-bf10-261c56036bdf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:07.958495 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e0f34b22-1cdd-454d-bf10-261c56036bdf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:07.958937 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e0f34b22-1cdd-454d-bf10-261c56036bdf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:07.959704 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e0f34b22-1cdd-454d-bf10-261c56036bdf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:07.960131 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-e0f34b22-1cdd-454d-bf10-261c56036bdf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:08.048573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-e0f34b22-1cdd-454d-bf10-261c56036bdf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 28189 microversion: 2.1 time: 0.101843 Dec 18 03:23:08.049213 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 563/1096] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:07 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 28189 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:09.060677 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-f87f141c-897d-4415-a764-462a2ec6295e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:09.062550 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-f87f141c-897d-4415-a764-462a2ec6295e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:09.069306 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f87f141c-897d-4415-a764-462a2ec6295e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:09.069776 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f87f141c-897d-4415-a764-462a2ec6295e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:09.070541 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f87f141c-897d-4415-a764-462a2ec6295e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:09.070968 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-f87f141c-897d-4415-a764-462a2ec6295e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:09.162747 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-f87f141c-897d-4415-a764-462a2ec6295e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 28479 microversion: 2.1 time: 0.105942 Dec 18 03:23:09.163383 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 534/1097] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:09 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 28479 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:10.175222 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-2908f430-2f76-44af-b830-5fb381d59d5c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:10.176254 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-2908f430-2f76-44af-b830-5fb381d59d5c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:10.183076 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2908f430-2f76-44af-b830-5fb381d59d5c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:10.183526 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2908f430-2f76-44af-b830-5fb381d59d5c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:10.184300 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2908f430-2f76-44af-b830-5fb381d59d5c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:10.184730 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-2908f430-2f76-44af-b830-5fb381d59d5c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:10.277885 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-2908f430-2f76-44af-b830-5fb381d59d5c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 28647 microversion: 2.1 time: 0.106671 Dec 18 03:23:10.278522 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 564/1098] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:10 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 28647 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:11.289907 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3583bfff-dc4c-4dab-bceb-02c01150f1b9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:11.290903 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3583bfff-dc4c-4dab-bceb-02c01150f1b9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:11.297694 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3583bfff-dc4c-4dab-bceb-02c01150f1b9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:11.298140 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3583bfff-dc4c-4dab-bceb-02c01150f1b9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:11.298903 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3583bfff-dc4c-4dab-bceb-02c01150f1b9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:11.299327 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3583bfff-dc4c-4dab-bceb-02c01150f1b9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:11.380785 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3583bfff-dc4c-4dab-bceb-02c01150f1b9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 28647 microversion: 2.1 time: 0.094897 Dec 18 03:23:11.381415 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 535/1099] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:11 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 28647 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:12.392140 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-5d6c9a28-ecca-4c34-b36a-f5b3784c1d78 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:12.393176 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-5d6c9a28-ecca-4c34-b36a-f5b3784c1d78 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:12.400165 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a28-ecca-4c34-b36a-f5b3784c1d78 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:12.400618 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a28-ecca-4c34-b36a-f5b3784c1d78 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:12.401404 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a28-ecca-4c34-b36a-f5b3784c1d78 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:12.401862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a28-ecca-4c34-b36a-f5b3784c1d78 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:12.489876 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-5d6c9a28-ecca-4c34-b36a-f5b3784c1d78 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 28647 microversion: 2.1 time: 0.101845 Dec 18 03:23:12.490543 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 565/1100] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:12 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 28647 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:13.502695 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-63fbb5f9-784c-4eca-825c-08d62ac69f16 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:13.503699 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-63fbb5f9-784c-4eca-825c-08d62ac69f16 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:13.510558 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63fbb5f9-784c-4eca-825c-08d62ac69f16 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:13.511004 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63fbb5f9-784c-4eca-825c-08d62ac69f16 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:13.511781 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63fbb5f9-784c-4eca-825c-08d62ac69f16 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:13.512214 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-63fbb5f9-784c-4eca-825c-08d62ac69f16 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:13.614748 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-63fbb5f9-784c-4eca-825c-08d62ac69f16 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 29750 microversion: 2.1 time: 0.116853 Dec 18 03:23:13.615377 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 536/1101] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:13 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 29750 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:14.627392 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b2fe5f82-4ca9-4c60-b5d2-c0cbca08a124 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:14.628401 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b2fe5f82-4ca9-4c60-b5d2-c0cbca08a124 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:14.635389 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b2fe5f82-4ca9-4c60-b5d2-c0cbca08a124 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:14.635786 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b2fe5f82-4ca9-4c60-b5d2-c0cbca08a124 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:14.636568 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b2fe5f82-4ca9-4c60-b5d2-c0cbca08a124 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:14.637010 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b2fe5f82-4ca9-4c60-b5d2-c0cbca08a124 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:14.729188 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b2fe5f82-4ca9-4c60-b5d2-c0cbca08a124 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 31930 microversion: 2.1 time: 0.106279 Dec 18 03:23:14.730088 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 566/1102] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:14 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 31930 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:15.740939 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a5450eb7-5ccb-4f90-b274-6a39326076cf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:15.742095 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a5450eb7-5ccb-4f90-b274-6a39326076cf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:15.748865 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a5450eb7-5ccb-4f90-b274-6a39326076cf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:15.749311 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a5450eb7-5ccb-4f90-b274-6a39326076cf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:15.750125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a5450eb7-5ccb-4f90-b274-6a39326076cf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:15.750559 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a5450eb7-5ccb-4f90-b274-6a39326076cf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:15.792751 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-fbe3aa07-1fc9-4bde-a2d0-cbca7b3584c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:15.793339 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-fbe3aa07-1fc9-4bde-a2d0-cbca7b3584c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:15.800210 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fbe3aa07-1fc9-4bde-a2d0-cbca7b3584c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:15.800664 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fbe3aa07-1fc9-4bde-a2d0-cbca7b3584c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:15.801446 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fbe3aa07-1fc9-4bde-a2d0-cbca7b3584c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:15.801974 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-fbe3aa07-1fc9-4bde-a2d0-cbca7b3584c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:15.827699 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-fbe3aa07-1fc9-4bde-a2d0-cbca7b3584c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:23:15.847144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a5450eb7-5ccb-4f90-b274-6a39326076cf tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 33374 microversion: 2.1 time: 0.109950 Dec 18 03:23:15.847892 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 537/1103] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:15 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 33374 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:15.918410 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-fbe3aa07-1fc9-4bde-a2d0-cbca7b3584c6 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 204 len: 0 microversion: 2.1 time: 0.128958 Dec 18 03:23:15.921082 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 567/1104] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:23:15 2021] DELETE /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 18 03:23:15.930145 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ebd660a6-2208-4a88-bf61-d36bec857111 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:15.930935 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ebd660a6-2208-4a88-bf61-d36bec857111 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:15.937396 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ebd660a6-2208-4a88-bf61-d36bec857111 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:15.937969 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ebd660a6-2208-4a88-bf61-d36bec857111 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:15.939105 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ebd660a6-2208-4a88-bf61-d36bec857111 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:15.940559 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ebd660a6-2208-4a88-bf61-d36bec857111 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:16.052519 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [req-c2cbb304-e9cd-4866-bba3-0ef29d4d7027 req-51bad09a-3caa-4aac-bd6b-85ff845dfafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d244df22-21b2-40e5-972f-e6678258f781", "tag": "60bc3098-1a05-43da-aad1-0105b3137056"}]} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:16.054689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:23:16.054689 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: warnings.warn(msg) Dec 18 03:23:16.062235 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-c2cbb304-e9cd-4866-bba3-0ef29d4d7027 req-51bad09a-3caa-4aac-bd6b-85ff845dfafd service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:16.062671 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [req-c2cbb304-e9cd-4866-bba3-0ef29d4d7027 req-51bad09a-3caa-4aac-bd6b-85ff845dfafd service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:16.073539 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.compute.server_external_events [req-c2cbb304-e9cd-4866-bba3-0ef29d4d7027 req-51bad09a-3caa-4aac-bd6b-85ff845dfafd service nova] Creating event network-changed:60bc3098-1a05-43da-aad1-0105b3137056 for instance d244df22-21b2-40e5-972f-e6678258f781 on hv-cinder-81803 Dec 18 03:23:16.080361 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-ebd660a6-2208-4a88-bf61-d36bec857111 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:23:16.087103 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [req-c2cbb304-e9cd-4866-bba3-0ef29d4d7027 req-51bad09a-3caa-4aac-bd6b-85ff845dfafd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237224 Dec 18 03:23:16.087653 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 538/1105] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:23:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:16.087776 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ebd660a6-2208-4a88-bf61-d36bec857111 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1567 microversion: 2.1 time: 0.162340 Dec 18 03:23:16.088297 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 568/1106] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:15 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:23:16.860840 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-d837ed9e-731d-4426-a7b4-5bf409417da8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:16.861904 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-d837ed9e-731d-4426-a7b4-5bf409417da8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:16.868260 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d837ed9e-731d-4426-a7b4-5bf409417da8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:16.868702 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d837ed9e-731d-4426-a7b4-5bf409417da8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:16.869481 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d837ed9e-731d-4426-a7b4-5bf409417da8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:16.869941 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-d837ed9e-731d-4426-a7b4-5bf409417da8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:16.966018 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-d837ed9e-731d-4426-a7b4-5bf409417da8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 34231 microversion: 2.1 time: 0.109896 Dec 18 03:23:16.966657 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 539/1107] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:16 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 34231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:17.104480 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b6235fce-c9a5-44fa-b57a-3f73d4f794af tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:17.105341 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b6235fce-c9a5-44fa-b57a-3f73d4f794af tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:17.112530 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b6235fce-c9a5-44fa-b57a-3f73d4f794af tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:17.113093 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b6235fce-c9a5-44fa-b57a-3f73d4f794af tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:17.113910 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b6235fce-c9a5-44fa-b57a-3f73d4f794af tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:17.114349 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b6235fce-c9a5-44fa-b57a-3f73d4f794af tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:17.245376 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-b6235fce-c9a5-44fa-b57a-3f73d4f794af tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:23:17.252942 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b6235fce-c9a5-44fa-b57a-3f73d4f794af tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1449 microversion: 2.1 time: 0.152175 Dec 18 03:23:17.253517 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 569/1108] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:17 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:23:17.978855 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-a324b5f4-f2f4-4bc5-9e64-a365712c25d2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:17.980112 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-a324b5f4-f2f4-4bc5-9e64-a365712c25d2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:17.987730 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a324b5f4-f2f4-4bc5-9e64-a365712c25d2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:17.988179 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a324b5f4-f2f4-4bc5-9e64-a365712c25d2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:17.988969 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a324b5f4-f2f4-4bc5-9e64-a365712c25d2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:17.989403 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-a324b5f4-f2f4-4bc5-9e64-a365712c25d2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:18.088795 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-a324b5f4-f2f4-4bc5-9e64-a365712c25d2 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 35147 microversion: 2.1 time: 0.113748 Dec 18 03:23:18.093054 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 540/1109] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:17 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 35147 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:18.265366 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-1ff49b08-c546-4510-a2ab-4edc9e96dbe5 req-3bbb9e18-0ad5-4768-9efa-24c11f1c323c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d244df22-21b2-40e5-972f-e6678258f781", "name": "network-vif-deleted", "tag": "60bc3098-1a05-43da-aad1-0105b3137056"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:18.266944 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:23:18.266944 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:23:18.270763 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-75e3b193-ccb8-4953-a0ee-bf10e97fc8bb tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:18.271465 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-75e3b193-ccb8-4953-a0ee-bf10e97fc8bb tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:18.276549 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-1ff49b08-c546-4510-a2ab-4edc9e96dbe5 req-3bbb9e18-0ad5-4768-9efa-24c11f1c323c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:18.277245 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-1ff49b08-c546-4510-a2ab-4edc9e96dbe5 req-3bbb9e18-0ad5-4768-9efa-24c11f1c323c service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:18.278831 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75e3b193-ccb8-4953-a0ee-bf10e97fc8bb tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:18.279982 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75e3b193-ccb8-4953-a0ee-bf10e97fc8bb tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:18.280624 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75e3b193-ccb8-4953-a0ee-bf10e97fc8bb tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:18.281046 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-75e3b193-ccb8-4953-a0ee-bf10e97fc8bb tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:18.293466 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-1ff49b08-c546-4510-a2ab-4edc9e96dbe5 req-3bbb9e18-0ad5-4768-9efa-24c11f1c323c service nova] Creating event network-vif-deleted:60bc3098-1a05-43da-aad1-0105b3137056 for instance d244df22-21b2-40e5-972f-e6678258f781 on hv-cinder-81803 Dec 18 03:23:18.301418 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-1ff49b08-c546-4510-a2ab-4edc9e96dbe5 req-3bbb9e18-0ad5-4768-9efa-24c11f1c323c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039319 Dec 18 03:23:18.302161 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 570/1110] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:23:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:18.352834 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-75e3b193-ccb8-4953-a0ee-bf10e97fc8bb tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622acc6ab6a44c4a82aa3b821bd814b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400be51814e84a6e8a54033024fad790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:23:18.362069 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-75e3b193-ccb8-4953-a0ee-bf10e97fc8bb tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 200 len: 1382 microversion: 2.1 time: 0.095872 Dec 18 03:23:18.362638 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 541/1111] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:18 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 1382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:23:19.102402 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f472a0be-7775-4bff-b40b-5a47fcf41d9e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:19.103398 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f472a0be-7775-4bff-b40b-5a47fcf41d9e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:19.111727 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f472a0be-7775-4bff-b40b-5a47fcf41d9e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:19.112181 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f472a0be-7775-4bff-b40b-5a47fcf41d9e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:19.113049 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f472a0be-7775-4bff-b40b-5a47fcf41d9e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:19.113501 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f472a0be-7775-4bff-b40b-5a47fcf41d9e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:19.218086 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f472a0be-7775-4bff-b40b-5a47fcf41d9e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 36410 microversion: 2.1 time: 0.120226 Dec 18 03:23:19.219053 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 571/1112] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:19 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 36410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:19.378967 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-89ef8020-3a57-4d01-b5b8-dabc67092755 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:19.379630 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-89ef8020-3a57-4d01-b5b8-dabc67092755 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] [instance: d244df22-21b2-40e5-972f-e6678258f781] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:19.386008 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-89ef8020-3a57-4d01-b5b8-dabc67092755 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:19.386457 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-89ef8020-3a57-4d01-b5b8-dabc67092755 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:19.387238 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-89ef8020-3a57-4d01-b5b8-dabc67092755 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:19.387676 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-89ef8020-3a57-4d01-b5b8-dabc67092755 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:19.401094 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-89ef8020-3a57-4d01-b5b8-dabc67092755 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] HTTP exception thrown: Instance d244df22-21b2-40e5-972f-e6678258f781 could not be found. Dec 18 03:23:19.401707 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-89ef8020-3a57-4d01-b5b8-dabc67092755 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Returning 404 to user: Instance d244df22-21b2-40e5-972f-e6678258f781 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:23:19.402539 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-89ef8020-3a57-4d01-b5b8-dabc67092755 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781" status: 404 len: 111 microversion: 2.1 time: 0.027263 Dec 18 03:23:19.403418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 542/1113] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:19 2021] GET /compute/v2.1/servers/d244df22-21b2-40e5-972f-e6678258f781 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:23:19.562983 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-71515730-8e77-4cc6-b96d-df1bf38a5156 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] Calling method '.version_select at 0x7fad26d14b80>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:19.589468 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-71515730-8e77-4cc6-b96d-df1bf38a5156 tempest-TestShelveInstance-1138838095 tempest-TestShelveInstance-1138838095-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1716447171" status: 202 len: 0 microversion: 2.1 time: 0.030686 Dec 18 03:23:19.590245 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 572/1114] 10.222.0.24 () {58 vars in 1253 bytes} [Sat Dec 18 03:23:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1716447171 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:23:20.230321 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b17ad0a7-9f50-4dfa-b91b-66eca44746b0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:20.231158 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b17ad0a7-9f50-4dfa-b91b-66eca44746b0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:20.237976 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b17ad0a7-9f50-4dfa-b91b-66eca44746b0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:20.238424 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b17ad0a7-9f50-4dfa-b91b-66eca44746b0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:20.239205 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b17ad0a7-9f50-4dfa-b91b-66eca44746b0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:20.239637 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b17ad0a7-9f50-4dfa-b91b-66eca44746b0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:20.330983 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b17ad0a7-9f50-4dfa-b91b-66eca44746b0 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 37963 microversion: 2.1 time: 0.104394 Dec 18 03:23:20.331618 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 543/1115] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:20 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 37963 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:21.343544 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d8225919-51d8-4d3d-bbf7-04edb5339ed8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:21.345466 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-d8225919-51d8-4d3d-bbf7-04edb5339ed8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:21.351437 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8225919-51d8-4d3d-bbf7-04edb5339ed8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:21.351920 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8225919-51d8-4d3d-bbf7-04edb5339ed8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:21.352898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8225919-51d8-4d3d-bbf7-04edb5339ed8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:21.353341 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-d8225919-51d8-4d3d-bbf7-04edb5339ed8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:21.448874 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d8225919-51d8-4d3d-bbf7-04edb5339ed8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 38177 microversion: 2.1 time: 0.109235 Dec 18 03:23:21.449960 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 573/1116] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:21 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 38177 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:22.463328 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-5346b8a2-69d5-4ab6-824e-13a5ff4f8235 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:22.464401 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-5346b8a2-69d5-4ab6-824e-13a5ff4f8235 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:22.472364 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5346b8a2-69d5-4ab6-824e-13a5ff4f8235 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:22.472818 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5346b8a2-69d5-4ab6-824e-13a5ff4f8235 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:22.482590 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5346b8a2-69d5-4ab6-824e-13a5ff4f8235 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:22.483146 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-5346b8a2-69d5-4ab6-824e-13a5ff4f8235 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:22.571071 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-5346b8a2-69d5-4ab6-824e-13a5ff4f8235 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 38177 microversion: 2.1 time: 0.111619 Dec 18 03:23:22.572431 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 544/1117] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:22 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 38177 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 18 03:23:23.583569 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8cdf0141-f906-4f7e-a94b-d74d0ba533ff tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:23.584604 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-8cdf0141-f906-4f7e-a94b-d74d0ba533ff tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:23.592949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cdf0141-f906-4f7e-a94b-d74d0ba533ff tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:23.593397 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cdf0141-f906-4f7e-a94b-d74d0ba533ff tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:23.594217 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cdf0141-f906-4f7e-a94b-d74d0ba533ff tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:23.594657 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-8cdf0141-f906-4f7e-a94b-d74d0ba533ff tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:23.680230 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8cdf0141-f906-4f7e-a94b-d74d0ba533ff tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 38177 microversion: 2.1 time: 0.100693 Dec 18 03:23:23.682337 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 574/1118] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:23 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 38177 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:24.692963 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-854147bd-0214-464b-a4c7-ad35aafec4b5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:24.693994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-854147bd-0214-464b-a4c7-ad35aafec4b5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:24.700851 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-854147bd-0214-464b-a4c7-ad35aafec4b5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:24.701340 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-854147bd-0214-464b-a4c7-ad35aafec4b5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:24.702144 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-854147bd-0214-464b-a4c7-ad35aafec4b5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:24.702581 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-854147bd-0214-464b-a4c7-ad35aafec4b5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:24.788928 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-854147bd-0214-464b-a4c7-ad35aafec4b5 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action" status: 200 len: 38306 microversion: 2.1 time: 0.099762 Dec 18 03:23:24.789582 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 545/1119] 10.222.0.24 () {60 vars in 1277 bytes} [Sat Dec 18 03:23:24 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/action => generated 38306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 18 03:23:24.800976 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-f2b40cbd-9592-4a82-a482-f36245ca5c3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:24.801756 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-f2b40cbd-9592-4a82-a482-f36245ca5c3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:24.808735 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f2b40cbd-9592-4a82-a482-f36245ca5c3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:24.809263 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f2b40cbd-9592-4a82-a482-f36245ca5c3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:24.811216 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f2b40cbd-9592-4a82-a482-f36245ca5c3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:24.811345 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-f2b40cbd-9592-4a82-a482-f36245ca5c3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:24.836381 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-f2b40cbd-9592-4a82-a482-f36245ca5c3c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/ips" status: 200 len: 146 microversion: 2.1 time: 0.039439 Dec 18 03:23:24.836973 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 575/1120] 10.222.0.24 () {58 vars in 1247 bytes} [Sat Dec 18 03:23:24 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:26.188731 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-913f6f83-ccd7-45b3-b04a-a1dff1e23775 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bd32694-6d2c-4e14-b874-8038737bf79f"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:26.189890 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-913f6f83-ccd7-45b3-b04a-a1dff1e23775 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:26.196717 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-913f6f83-ccd7-45b3-b04a-a1dff1e23775 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:26.197159 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-913f6f83-ccd7-45b3-b04a-a1dff1e23775 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:26.197963 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-913f6f83-ccd7-45b3-b04a-a1dff1e23775 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:26.198399 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-913f6f83-ccd7-45b3-b04a-a1dff1e23775 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:26.465538 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-913f6f83-ccd7-45b3-b04a-a1dff1e23775 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281358 Dec 18 03:23:26.467178 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 546/1121] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:23:26 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:33.922135 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a792779a-d5d1-4399-968d-1a58a421b007 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:33.923074 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a792779a-d5d1-4399-968d-1a58a421b007 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:33.929373 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a792779a-d5d1-4399-968d-1a58a421b007 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:33.929862 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a792779a-d5d1-4399-968d-1a58a421b007 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:33.930683 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a792779a-d5d1-4399-968d-1a58a421b007 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:33.931122 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a792779a-d5d1-4399-968d-1a58a421b007 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:33.961556 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a792779a-d5d1-4399-968d-1a58a421b007 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Dec 18 03:23:33.962140 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 576/1122] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:23:33 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:33.973121 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-19934d95-7ac6-49b2-a2b6-10181816a1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:33.973749 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-19934d95-7ac6-49b2-a2b6-10181816a1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:33.980413 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19934d95-7ac6-49b2-a2b6-10181816a1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:33.980867 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19934d95-7ac6-49b2-a2b6-10181816a1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:33.981659 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19934d95-7ac6-49b2-a2b6-10181816a1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:33.982094 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-19934d95-7ac6-49b2-a2b6-10181816a1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:34.011791 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-19934d95-7ac6-49b2-a2b6-10181816a1b4 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/5bd32694-6d2c-4e14-b874-8038737bf79f" status: 200 len: 194 microversion: 2.1 time: 0.042646 Dec 18 03:23:34.012369 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 547/1123] 10.222.0.24 () {58 vars in 1412 bytes} [Sat Dec 18 03:23:33 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/5bd32694-6d2c-4e14-b874-8038737bf79f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:35.310928 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-43239508-ff21-4134-a0a1-65c110b1332e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34281883-c40c-468b-9c79-3bbf8070a7e4"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:35.312059 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-43239508-ff21-4134-a0a1-65c110b1332e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:35.318452 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43239508-ff21-4134-a0a1-65c110b1332e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:35.318898 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43239508-ff21-4134-a0a1-65c110b1332e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:35.319669 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43239508-ff21-4134-a0a1-65c110b1332e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:35.320103 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-43239508-ff21-4134-a0a1-65c110b1332e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:35.560051 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-43239508-ff21-4134-a0a1-65c110b1332e tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252888 Dec 18 03:23:35.561274 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 577/1124] 10.222.0.24 () {60 vars in 1322 bytes} [Sat Dec 18 03:23:35 2021] POST /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 18 03:23:43.009958 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-3ed4a05a-d2a9-44b4-8e33-745f3b3c575d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:43.010917 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-3ed4a05a-d2a9-44b4-8e33-745f3b3c575d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:43.017235 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ed4a05a-d2a9-44b4-8e33-745f3b3c575d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:43.017716 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ed4a05a-d2a9-44b4-8e33-745f3b3c575d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:43.018483 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ed4a05a-d2a9-44b4-8e33-745f3b3c575d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:43.018911 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-3ed4a05a-d2a9-44b4-8e33-745f3b3c575d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:43.048035 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-3ed4a05a-d2a9-44b4-8e33-745f3b3c575d tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041769 Dec 18 03:23:43.048565 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 548/1125] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:23:43 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:43.220064 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b7f52289-c101-4280-ae1b-a6bd8d71262b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:43.220639 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b7f52289-c101-4280-ae1b-a6bd8d71262b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:43.226725 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7f52289-c101-4280-ae1b-a6bd8d71262b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:43.227170 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7f52289-c101-4280-ae1b-a6bd8d71262b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:43.227942 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7f52289-c101-4280-ae1b-a6bd8d71262b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:43.228374 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b7f52289-c101-4280-ae1b-a6bd8d71262b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:43.256481 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b7f52289-c101-4280-ae1b-a6bd8d71262b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/5bd32694-6d2c-4e14-b874-8038737bf79f" status: 200 len: 194 microversion: 2.1 time: 0.041864 Dec 18 03:23:43.257047 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 578/1126] 10.222.0.24 () {58 vars in 1412 bytes} [Sat Dec 18 03:23:43 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/5bd32694-6d2c-4e14-b874-8038737bf79f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:43.267106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0195d413-3790-410b-bae9-6a9169634fc8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:43.267594 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-0195d413-3790-410b-bae9-6a9169634fc8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:43.273830 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0195d413-3790-410b-bae9-6a9169634fc8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:43.274277 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0195d413-3790-410b-bae9-6a9169634fc8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:43.275051 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0195d413-3790-410b-bae9-6a9169634fc8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:43.275487 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-0195d413-3790-410b-bae9-6a9169634fc8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:43.351741 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-0195d413-3790-410b-bae9-6a9169634fc8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lazy-loading 'services' on Instance uuid 20a4f5c1-5640-4b05-8d47-ced994ed06b6 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:23:43.422046 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0195d413-3790-410b-bae9-6a9169634fc8 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "DELETE /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/5bd32694-6d2c-4e14-b874-8038737bf79f" status: 202 len: 0 microversion: 2.1 time: 0.158926 Dec 18 03:23:43.422646 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 549/1127] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:23:43 2021] DELETE /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/5bd32694-6d2c-4e14-b874-8038737bf79f => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:23:44.528949 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-ee9ab2b4-daa6-4c78-926a-1295705d470c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:44.529492 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-ee9ab2b4-daa6-4c78-926a-1295705d470c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:44.536643 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee9ab2b4-daa6-4c78-926a-1295705d470c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:44.537095 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee9ab2b4-daa6-4c78-926a-1295705d470c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:44.537931 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee9ab2b4-daa6-4c78-926a-1295705d470c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:44.538368 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-ee9ab2b4-daa6-4c78-926a-1295705d470c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:44.566726 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-ee9ab2b4-daa6-4c78-926a-1295705d470c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/34281883-c40c-468b-9c79-3bbf8070a7e4" status: 200 len: 194 microversion: 2.1 time: 0.041482 Dec 18 03:23:44.567298 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 579/1128] 10.222.0.24 () {58 vars in 1412 bytes} [Sat Dec 18 03:23:44 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/34281883-c40c-468b-9c79-3bbf8070a7e4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:44.578064 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-aa42122c-c720-43da-9cfc-af3b935fbef1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:44.578641 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-aa42122c-c720-43da-9cfc-af3b935fbef1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:44.584604 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa42122c-c720-43da-9cfc-af3b935fbef1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:44.585045 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa42122c-c720-43da-9cfc-af3b935fbef1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:44.585849 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa42122c-c720-43da-9cfc-af3b935fbef1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:44.586278 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-aa42122c-c720-43da-9cfc-af3b935fbef1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:44.661688 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.objects.instance [None req-aa42122c-c720-43da-9cfc-af3b935fbef1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lazy-loading 'services' on Instance uuid 20a4f5c1-5640-4b05-8d47-ced994ed06b6 {{(pid=116000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 18 03:23:44.729498 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-aa42122c-c720-43da-9cfc-af3b935fbef1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "DELETE /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/34281883-c40c-468b-9c79-3bbf8070a7e4" status: 202 len: 0 microversion: 2.1 time: 0.156030 Dec 18 03:23:44.730109 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 550/1129] 10.222.0.24 () {58 vars in 1415 bytes} [Sat Dec 18 03:23:44 2021] DELETE /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments/34281883-c40c-468b-9c79-3bbf8070a7e4 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:23:45.878518 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-192b2eb7-60da-423d-b2aa-cf89fa95414c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:45.879504 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-192b2eb7-60da-423d-b2aa-cf89fa95414c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:45.885718 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-192b2eb7-60da-423d-b2aa-cf89fa95414c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:45.886174 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-192b2eb7-60da-423d-b2aa-cf89fa95414c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:45.886945 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-192b2eb7-60da-423d-b2aa-cf89fa95414c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:45.887384 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-192b2eb7-60da-423d-b2aa-cf89fa95414c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:45.916808 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-192b2eb7-60da-423d-b2aa-cf89fa95414c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041993 Dec 18 03:23:45.917365 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 580/1130] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:23:45 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:23:46.015992 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-b3f4dc0d-c95f-4997-9db1-3828b8d82346 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:46.016982 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-b3f4dc0d-c95f-4997-9db1-3828b8d82346 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:46.022975 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3f4dc0d-c95f-4997-9db1-3828b8d82346 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:46.023418 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3f4dc0d-c95f-4997-9db1-3828b8d82346 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:46.024192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3f4dc0d-c95f-4997-9db1-3828b8d82346 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:46.024623 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-b3f4dc0d-c95f-4997-9db1-3828b8d82346 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:46.054573 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-b3f4dc0d-c95f-4997-9db1-3828b8d82346 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043181 Dec 18 03:23:46.055046 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 551/1131] 10.222.0.24 () {58 vars in 1301 bytes} [Sat Dec 18 03:23:46 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 18 03:23:46.108573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b9083d70-22eb-4654-8b00-ec0e994e2ad3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:46.109083 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b9083d70-22eb-4654-8b00-ec0e994e2ad3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:46.115650 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b9083d70-22eb-4654-8b00-ec0e994e2ad3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:46.116111 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b9083d70-22eb-4654-8b00-ec0e994e2ad3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:46.116889 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b9083d70-22eb-4654-8b00-ec0e994e2ad3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:46.117330 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-b9083d70-22eb-4654-8b00-ec0e994e2ad3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:46.140967 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-b9083d70-22eb-4654-8b00-ec0e994e2ad3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Going to try to terminate instance {{(pid=116001) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 18 03:23:46.211399 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b9083d70-22eb-4654-8b00-ec0e994e2ad3 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "DELETE /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 204 len: 0 microversion: 2.1 time: 0.106999 Dec 18 03:23:46.212031 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 581/1132] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:23:46 2021] DELETE /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 18 03:23:46.220329 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-24d505f3-2a38-4606-82e1-3d2fe09151a7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:46.220927 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-24d505f3-2a38-4606-82e1-3d2fe09151a7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:46.226735 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-24d505f3-2a38-4606-82e1-3d2fe09151a7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:46.227181 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-24d505f3-2a38-4606-82e1-3d2fe09151a7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:46.227950 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-24d505f3-2a38-4606-82e1-3d2fe09151a7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:46.228382 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-24d505f3-2a38-4606-82e1-3d2fe09151a7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:46.359792 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-24d505f3-2a38-4606-82e1-3d2fe09151a7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:23:46.367054 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-24d505f3-2a38-4606-82e1-3d2fe09151a7 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1674 microversion: 2.1 time: 0.150818 Dec 18 03:23:46.367604 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 552/1133] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:46 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:23:47.384668 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-a94ccb3f-9e81-4be2-b28e-36d6da764c4a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:47.385370 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-a94ccb3f-9e81-4be2-b28e-36d6da764c4a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:47.391730 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a94ccb3f-9e81-4be2-b28e-36d6da764c4a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:47.392177 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a94ccb3f-9e81-4be2-b28e-36d6da764c4a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:47.392950 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a94ccb3f-9e81-4be2-b28e-36d6da764c4a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:47.393385 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-a94ccb3f-9e81-4be2-b28e-36d6da764c4a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:47.526441 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.policy [None req-a94ccb3f-9e81-4be2-b28e-36d6da764c4a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116001) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:23:47.534497 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-a94ccb3f-9e81-4be2-b28e-36d6da764c4a tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1674 microversion: 2.1 time: 0.153897 Dec 18 03:23:47.535062 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 582/1134] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:47 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:23:48.552299 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-df9410d2-d00d-482f-916a-0d377e87e8de tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:48.552927 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-df9410d2-d00d-482f-916a-0d377e87e8de tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:48.559350 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df9410d2-d00d-482f-916a-0d377e87e8de tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:48.559799 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df9410d2-d00d-482f-916a-0d377e87e8de tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:48.560620 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df9410d2-d00d-482f-916a-0d377e87e8de tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:48.561740 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-df9410d2-d00d-482f-916a-0d377e87e8de tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:48.656143 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.policy [None req-df9410d2-d00d-482f-916a-0d377e87e8de tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c719df3f54e442790c9a6c9d1e687e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef52b4e7164c93988c7ca58686d98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116000) authorize /opt/stack/nova/nova/policy.py:199}} Dec 18 03:23:48.663467 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-df9410d2-d00d-482f-916a-0d377e87e8de tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 200 len: 1606 microversion: 2.1 time: 0.115119 Dec 18 03:23:48.664033 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 553/1135] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:48 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 1606 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 18 03:23:48.871352 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [req-056e3858-553a-44b9-8ae3-c04de5323a02 req-716fda03-afc5-4598-a4d2-dcd0437f56e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a4f5c1-5640-4b05-8d47-ced994ed06b6", "name": "network-vif-deleted", "tag": "7c901558-680c-49ed-b1ad-c108605f42fa"}]} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:48.872975 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 03:23:48.872975 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: warnings.warn(msg) Dec 18 03:23:48.880852 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-056e3858-553a-44b9-8ae3-c04de5323a02 req-716fda03-afc5-4598-a4d2-dcd0437f56e6 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:48.881289 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [req-056e3858-553a-44b9-8ae3-c04de5323a02 req-716fda03-afc5-4598-a4d2-dcd0437f56e6 service nova] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:48.893189 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.compute.server_external_events [req-056e3858-553a-44b9-8ae3-c04de5323a02 req-716fda03-afc5-4598-a4d2-dcd0437f56e6 service nova] Creating event network-vif-deleted:7c901558-680c-49ed-b1ad-c108605f42fa for instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 on hv-cinder-81803 Dec 18 03:23:48.898086 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [req-056e3858-553a-44b9-8ae3-c04de5323a02 req-716fda03-afc5-4598-a4d2-dcd0437f56e6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030306 Dec 18 03:23:48.898649 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 583/1136] 10.222.0.24 () {64 vars in 1317 bytes} [Sat Dec 18 03:23:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:49.680164 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c29ffed5-fb74-4f46-bfd3-b26f77993d0b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:49.680777 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-c29ffed5-fb74-4f46-bfd3-b26f77993d0b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:49.687968 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c29ffed5-fb74-4f46-bfd3-b26f77993d0b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:49.688409 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c29ffed5-fb74-4f46-bfd3-b26f77993d0b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:49.689196 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c29ffed5-fb74-4f46-bfd3-b26f77993d0b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:49.689643 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-c29ffed5-fb74-4f46-bfd3-b26f77993d0b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:49.704679 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-c29ffed5-fb74-4f46-bfd3-b26f77993d0b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] HTTP exception thrown: Instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 could not be found. Dec 18 03:23:49.705266 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c29ffed5-fb74-4f46-bfd3-b26f77993d0b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Returning 404 to user: Instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:23:49.706125 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c29ffed5-fb74-4f46-bfd3-b26f77993d0b tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 404 len: 111 microversion: 2.1 time: 0.029703 Dec 18 03:23:49.709942 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 554/1137] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:49 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:23:49.715205 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-b94aeab6-16a7-4ef8-ab0d-8ef3e87a43d1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '.version_select at 0x7fad26b13550>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:49.733653 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-b94aeab6-16a7-4ef8-ab0d-8ef3e87a43d1 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537701310" status: 202 len: 0 microversion: 2.1 time: 0.022264 Dec 18 03:23:49.734227 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 584/1138] 10.222.0.24 () {58 vars in 1220 bytes} [Sat Dec 18 03:23:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537701310 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 18 03:23:52.573357 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-dd6c690f-7d94-4d41-97cc-1acbff2d1397 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:52.573944 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-dd6c690f-7d94-4d41-97cc-1acbff2d1397 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:52.580819 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dd6c690f-7d94-4d41-97cc-1acbff2d1397 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:52.581261 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dd6c690f-7d94-4d41-97cc-1acbff2d1397 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:52.582055 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dd6c690f-7d94-4d41-97cc-1acbff2d1397 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:52.582487 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-dd6c690f-7d94-4d41-97cc-1acbff2d1397 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:52.595722 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-dd6c690f-7d94-4d41-97cc-1acbff2d1397 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] HTTP exception thrown: Instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 could not be found. Dec 18 03:23:52.596302 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-dd6c690f-7d94-4d41-97cc-1acbff2d1397 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Returning 404 to user: Instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:23:52.597106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-dd6c690f-7d94-4d41-97cc-1acbff2d1397 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "DELETE /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 404 len: 111 microversion: 2.1 time: 0.027391 Dec 18 03:23:52.597633 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 555/1139] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:23:52 2021] DELETE /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:23:52.606072 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0da6284f-1f56-4cd8-bf42-a75193af2eb9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:52.606837 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0da6284f-1f56-4cd8-bf42-a75193af2eb9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 20a4f5c1-5640-4b05-8d47-ced994ed06b6] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:52.613451 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0da6284f-1f56-4cd8-bf42-a75193af2eb9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:52.613927 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0da6284f-1f56-4cd8-bf42-a75193af2eb9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:52.614702 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0da6284f-1f56-4cd8-bf42-a75193af2eb9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:52.615136 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0da6284f-1f56-4cd8-bf42-a75193af2eb9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:52.628537 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-0da6284f-1f56-4cd8-bf42-a75193af2eb9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] HTTP exception thrown: Instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 could not be found. Dec 18 03:23:52.629106 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0da6284f-1f56-4cd8-bf42-a75193af2eb9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Returning 404 to user: Instance 20a4f5c1-5640-4b05-8d47-ced994ed06b6 could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:23:52.629932 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0da6284f-1f56-4cd8-bf42-a75193af2eb9 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6" status: 404 len: 111 microversion: 2.1 time: 0.028363 Dec 18 03:23:52.630458 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 585/1140] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:52 2021] GET /compute/v2.1/servers/20a4f5c1-5640-4b05-8d47-ced994ed06b6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:23:53.755082 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9bd6fb45-f324-49bf-a404-e10573b5a00c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:53.755555 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.compute.api [None req-9bd6fb45-f324-49bf-a404-e10573b5a00c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116000) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:53.761949 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9bd6fb45-f324-49bf-a404-e10573b5a00c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:53.762397 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9bd6fb45-f324-49bf-a404-e10573b5a00c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:53.763171 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9bd6fb45-f324-49bf-a404-e10573b5a00c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:53.763602 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG oslo_concurrency.lockutils [None req-9bd6fb45-f324-49bf-a404-e10573b5a00c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:53.777027 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-9bd6fb45-f324-49bf-a404-e10573b5a00c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] HTTP exception thrown: Instance 1d21616b-5525-492c-a7ac-85e63612742a could not be found. Dec 18 03:23:53.777595 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9bd6fb45-f324-49bf-a404-e10573b5a00c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Returning 404 to user: Instance 1d21616b-5525-492c-a7ac-85e63612742a could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:23:53.778407 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9bd6fb45-f324-49bf-a404-e10573b5a00c tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 404 len: 111 microversion: 2.1 time: 0.027607 Dec 18 03:23:53.778916 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 556/1141] 10.222.0.24 () {58 vars in 1238 bytes} [Sat Dec 18 03:23:53 2021] DELETE /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:23:53.786353 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0e4d64ba-4c1b-41cf-b291-9ccd2e44c231 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Calling method '>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:53.786961 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.compute.api [None req-0e4d64ba-4c1b-41cf-b291-9ccd2e44c231 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] [instance: 1d21616b-5525-492c-a7ac-85e63612742a] Fetching instance by UUID {{(pid=116001) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 18 03:23:53.793161 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0e4d64ba-4c1b-41cf-b291-9ccd2e44c231 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:53.793604 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0e4d64ba-4c1b-41cf-b291-9ccd2e44c231 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:53.794393 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0e4d64ba-4c1b-41cf-b291-9ccd2e44c231 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 18 03:23:53.794821 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG oslo_concurrency.lockutils [None req-0e4d64ba-4c1b-41cf-b291-9ccd2e44c231 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Lock "43b8c604-540b-400e-b8d3-fef97c564d54" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 18 03:23:53.808200 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-0e4d64ba-4c1b-41cf-b291-9ccd2e44c231 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] HTTP exception thrown: Instance 1d21616b-5525-492c-a7ac-85e63612742a could not be found. Dec 18 03:23:53.808764 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0e4d64ba-4c1b-41cf-b291-9ccd2e44c231 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] Returning 404 to user: Instance 1d21616b-5525-492c-a7ac-85e63612742a could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:23:53.809553 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0e4d64ba-4c1b-41cf-b291-9ccd2e44c231 tempest-AttachVolumeTestJSON-671729660 tempest-AttachVolumeTestJSON-671729660-project] 10.222.0.24 "GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a" status: 404 len: 111 microversion: 2.1 time: 0.026812 Dec 18 03:23:53.810214 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 586/1142] 10.222.0.24 () {58 vars in 1235 bytes} [Sat Dec 18 03:23:53 2021] GET /compute/v2.1/servers/1d21616b-5525-492c-a7ac-85e63612742a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:23:58.067184 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-19174f8d-458e-4549-b0fb-59666693c537 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Action: 'create', calling method: .version_select at 0x7fad261be1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-694099491"}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:58.336684 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-19174f8d-458e-4549-b0fb-59666693c537 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.378344 Dec 18 03:23:58.337298 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 557/1143] 10.222.0.24 () {60 vars in 1154 bytes} [Sat Dec 18 03:23:57 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 380 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 18 03:23:58.347980 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-7f27f903-acc6-4c43-a93e-5c15d1e52223 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26bb4790>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:58.396453 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-7f27f903-acc6-4c43-a93e-5c15d1e52223 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b" status: 200 len: 344 microversion: 2.1 time: 0.052087 Dec 18 03:23:58.397014 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 587/1144] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:23:58 2021] GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:59.410187 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-0942d7f0-1f3a-4d68-9e88-597ad3ad4bac tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad262001f0>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:59.456202 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-0942d7f0-1f3a-4d68-9e88-597ad3ad4bac tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b" status: 200 len: 345 microversion: 2.1 time: 0.051043 Dec 18 03:23:59.456768 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 558/1145] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:23:59 2021] GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:59.467913 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-0eda7ae8-9809-404e-a23b-c60a61f5450f tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Action: 'create', calling method: .version_select at 0x7fad260c79d0>, body: {"snapshot": {"volume_id": "d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-50232172"}} {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:23:59.616426 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-0eda7ae8-9809-404e-a23b-c60a61f5450f tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.152488 Dec 18 03:23:59.617010 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 588/1146] 10.222.0.24 () {60 vars in 1161 bytes} [Sat Dec 18 03:23:59 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:59.626876 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6c7a2f8d-a62e-4e9b-be1c-e57ad11db948 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad261beee0>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:59.656032 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6c7a2f8d-a62e-4e9b-be1c-e57ad11db948 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f" status: 200 len: 285 microversion: 2.1 time: 0.032895 Dec 18 03:23:59.656513 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 559/1147] 10.222.0.24 () {58 vars in 1250 bytes} [Sat Dec 18 03:23:59 2021] GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f => generated 285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:59.666505 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-4fbb7be9-5174-4b07-b9f9-43202ba7e97b tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26117040>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:59.694366 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-4fbb7be9-5174-4b07-b9f9-43202ba7e97b tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.031407 Dec 18 03:23:59.694928 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 589/1148] 10.222.0.24 () {58 vars in 1139 bytes} [Sat Dec 18 03:23:59 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:23:59.704788 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-4f861e8c-4b1c-4aa7-aa95-93bbe3fa10d6 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad262a50d0>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:23:59.735297 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-4f861e8c-4b1c-4aa7-aa95-93bbe3fa10d6 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f" status: 200 len: 285 microversion: 2.1 time: 0.034215 Dec 18 03:23:59.736001 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 560/1149] 10.222.0.24 () {58 vars in 1250 bytes} [Sat Dec 18 03:23:59 2021] GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:00.747203 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-fef12063-ab8a-49b6-8bc7-4cf99df134d2 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26c29940>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:00.775485 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-fef12063-ab8a-49b6-8bc7-4cf99df134d2 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f" status: 200 len: 285 microversion: 2.1 time: 0.032447 Dec 18 03:24:00.776031 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 590/1150] 10.222.0.24 () {58 vars in 1250 bytes} [Sat Dec 18 03:24:00 2021] GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f => generated 285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:01.787518 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-7a2147ad-e2ff-46c5-9885-55c7c67004b9 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad2612fc10>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:01.815712 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-7a2147ad-e2ff-46c5-9885-55c7c67004b9 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f" status: 200 len: 285 microversion: 2.1 time: 0.032320 Dec 18 03:24:01.816237 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 561/1151] 10.222.0.24 () {58 vars in 1250 bytes} [Sat Dec 18 03:24:01 2021] GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f => generated 285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:02.827637 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-d783d6d4-f3d0-47f6-909a-0da3bde5cf3d tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26b8f9d0>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:02.857551 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-d783d6d4-f3d0-47f6-909a-0da3bde5cf3d tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f" status: 200 len: 286 microversion: 2.1 time: 0.034035 Dec 18 03:24:02.858133 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 591/1152] 10.222.0.24 () {58 vars in 1250 bytes} [Sat Dec 18 03:24:02 2021] GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:02.868330 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-15639d57-6037-4650-a63c-57eb4ea5a289 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad261bed30>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:02.921084 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-15639d57-6037-4650-a63c-57eb4ea5a289 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f" status: 202 len: 0 microversion: 2.1 time: 0.056662 Dec 18 03:24:02.921676 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 562/1153] 10.222.0.24 () {58 vars in 1253 bytes} [Sat Dec 18 03:24:02 2021] DELETE /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:24:02.929573 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-01b8a6c4-004d-42e6-a022-26b2c298aba0 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26b8ff70>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:02.957399 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-01b8a6c4-004d-42e6-a022-26b2c298aba0 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f" status: 200 len: 285 microversion: 2.1 time: 0.031381 Dec 18 03:24:02.957981 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 592/1154] 10.222.0.24 () {58 vars in 1250 bytes} [Sat Dec 18 03:24:02 2021] GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f => generated 285 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:03.968737 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9e22c43c-05a2-41ae-9b9a-53ab34be8328 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26200670>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:03.991963 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-9e22c43c-05a2-41ae-9b9a-53ab34be8328 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] HTTP exception thrown: Snapshot 57abca82-5391-4db8-9116-fa50f759035f could not be found. Dec 18 03:24:03.992566 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-9e22c43c-05a2-41ae-9b9a-53ab34be8328 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Returning 404 to user: Snapshot 57abca82-5391-4db8-9116-fa50f759035f could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:24:03.993364 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-9e22c43c-05a2-41ae-9b9a-53ab34be8328 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f" status: 404 len: 111 microversion: 2.1 time: 0.028809 Dec 18 03:24:03.993916 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 563/1155] 10.222.0.24 () {58 vars in 1250 bytes} [Sat Dec 18 03:24:03 2021] GET /compute/v2.1/os-snapshots/57abca82-5391-4db8-9116-fa50f759035f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:24:04.002732 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-bdc30bde-3e17-4b91-8f41-7e3d63bba347 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26bb4790>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:04.059385 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-bdc30bde-3e17-4b91-8f41-7e3d63bba347 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b" status: 202 len: 0 microversion: 2.1 time: 0.061182 Dec 18 03:24:04.060478 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 593/1156] 10.222.0.24 () {58 vars in 1247 bytes} [Sat Dec 18 03:24:03 2021] DELETE /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:24:04.069154 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6b0ad4b5-2d30-429c-a955-f2a983fde7d1 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26200c10>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:04.114772 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6b0ad4b5-2d30-429c-a955-f2a983fde7d1 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b" status: 200 len: 344 microversion: 2.1 time: 0.049112 Dec 18 03:24:04.115323 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 564/1157] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:24:04 2021] GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:05.128716 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8e97ea27-dd72-40d9-91f0-749407891e6a tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26117820>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:05.154583 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-8e97ea27-dd72-40d9-91f0-749407891e6a tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] HTTP exception thrown: Volume d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b could not be found. Dec 18 03:24:05.155175 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8e97ea27-dd72-40d9-91f0-749407891e6a tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Returning 404 to user: Volume d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:24:05.155988 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8e97ea27-dd72-40d9-91f0-749407891e6a tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b" status: 404 len: 109 microversion: 2.1 time: 0.032184 Dec 18 03:24:05.156526 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 594/1158] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:24:05 2021] GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:24:05.166159 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-59427ffe-af96-410c-be60-46210201745c tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26256430>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:05.192994 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-59427ffe-af96-410c-be60-46210201745c tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] HTTP exception thrown: Volume d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b could not be found. Dec 18 03:24:05.193576 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-59427ffe-af96-410c-be60-46210201745c tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Returning 404 to user: Volume d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:24:05.194402 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-59427ffe-af96-410c-be60-46210201745c tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b" status: 404 len: 109 microversion: 2.1 time: 0.032308 Dec 18 03:24:05.194922 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 565/1159] 10.222.0.24 () {58 vars in 1247 bytes} [Sat Dec 18 03:24:05 2021] DELETE /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:24:05.202469 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1931c1be-677b-4101-b8aa-45bb84958af2 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Calling method '.version_select at 0x7fad26bb4280>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:05.227279 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.wsgi [None req-1931c1be-677b-4101-b8aa-45bb84958af2 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] HTTP exception thrown: Volume d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b could not be found. Dec 18 03:24:05.227855 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-1931c1be-677b-4101-b8aa-45bb84958af2 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] Returning 404 to user: Volume d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b could not be found. {{(pid=116001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:24:05.228645 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-1931c1be-677b-4101-b8aa-45bb84958af2 tempest-VolumesSnapshotsTestJSON-1678230583 tempest-VolumesSnapshotsTestJSON-1678230583-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b" status: 404 len: 109 microversion: 2.1 time: 0.029757 Dec 18 03:24:05.229182 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 595/1160] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:24:05 2021] GET /compute/v2.1/os-volumes/d1a0cbb8-c2ec-4b60-9930-7dbc0b16470b => generated 109 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:24:06.536061 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-c0c2e84e-2493-419c-814b-3bf9400310be tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] Action: 'create', calling method: .version_select at 0x7fad26256160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1533161905", "metadata": {"Type": "work"}}} {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 18 03:24:06.804106 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-c0c2e84e-2493-419c-814b-3bf9400310be tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.384424 Dec 18 03:24:06.804791 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 566/1161] 10.222.0.24 () {60 vars in 1155 bytes} [Sat Dec 18 03:24:06 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 386 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 18 03:24:06.817511 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-8f7f79c1-73cd-4aca-9281-1707379054b6 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] Calling method '.version_select at 0x7fad26bb4550>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:06.865798 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-8f7f79c1-73cd-4aca-9281-1707379054b6 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82" status: 200 len: 353 microversion: 2.1 time: 0.053698 Dec 18 03:24:06.866365 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 596/1162] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:24:06 2021] GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:07.879341 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-15edd5b0-92ed-476b-ae39-d21bb4175e57 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] Calling method '.version_select at 0x7fad261f4040>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:07.923132 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-15edd5b0-92ed-476b-ae39-d21bb4175e57 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82" status: 200 len: 354 microversion: 2.1 time: 0.048724 Dec 18 03:24:07.923760 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 567/1163] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:24:07 2021] GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:07.934651 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-35bfa2ba-09e3-4662-a6cb-92caf53fee8a tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] Calling method '.version_select at 0x7fad26acb280>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:07.980189 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-35bfa2ba-09e3-4662-a6cb-92caf53fee8a tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82" status: 200 len: 354 microversion: 2.1 time: 0.049477 Dec 18 03:24:07.981018 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 597/1164] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:24:07 2021] GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:07.997192 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-6bfefe90-7159-4dc8-aa24-44d8f2593557 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] Calling method '.version_select at 0x7fad262faf70>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:08.053882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-6bfefe90-7159-4dc8-aa24-44d8f2593557 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82" status: 202 len: 0 microversion: 2.1 time: 0.060259 Dec 18 03:24:08.054534 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 568/1165] 10.222.0.24 () {58 vars in 1247 bytes} [Sat Dec 18 03:24:07 2021] DELETE /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 18 03:24:08.062202 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: DEBUG nova.api.openstack.wsgi [None req-6282767d-3110-4b94-b5ad-9c5ea43b8111 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] Calling method '.version_select at 0x7fad26d30550>' {{(pid=116001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:08.107925 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO nova.api.openstack.requestlog [None req-6282767d-3110-4b94-b5ad-9c5ea43b8111 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82" status: 200 len: 353 microversion: 2.1 time: 0.049110 Dec 18 03:24:08.108544 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: [pid: 116001|app: 0|req: 598/1166] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:24:08 2021] GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 18 03:24:09.122978 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-10360c57-8cfa-4a06-a485-510f802b9be4 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] Calling method '.version_select at 0x7fad261f4280>' {{(pid=116000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 18 03:24:09.148447 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.wsgi [None req-10360c57-8cfa-4a06-a485-510f802b9be4 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] HTTP exception thrown: Volume effbbe17-2ec0-4608-ae3e-2c32564c9b82 could not be found. Dec 18 03:24:09.149040 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: DEBUG nova.api.openstack.wsgi [None req-10360c57-8cfa-4a06-a485-510f802b9be4 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] Returning 404 to user: Volume effbbe17-2ec0-4608-ae3e-2c32564c9b82 could not be found. {{(pid=116000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 18 03:24:09.149882 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO nova.api.openstack.requestlog [None req-10360c57-8cfa-4a06-a485-510f802b9be4 tempest-VolumesGetTestJSON-1059753550 tempest-VolumesGetTestJSON-1059753550-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82" status: 404 len: 109 microversion: 2.1 time: 0.031418 Dec 18 03:24:09.150405 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: [pid: 116000|app: 0|req: 569/1167] 10.222.0.24 () {58 vars in 1244 bytes} [Sat Dec 18 03:24:09 2021] GET /compute/v2.1/os-volumes/effbbe17-2ec0-4608-ae3e-2c32564c9b82 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 18 03:25:32.867358 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:25:32.868078 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: Sat Dec 18 03:25:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 03:25:39.367249 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:25:39.367931 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: Sat Dec 18 03:25:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 03:26:36.290354 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:26:36.290956 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: Sat Dec 18 03:26:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 03:27:12.386823 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:27:12.387554 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: Sat Dec 18 03:27:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 03:28:52.885049 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:28:52.885649 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: Sat Dec 18 03:28:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 03:28:59.384531 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:28:59.385194 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: Sat Dec 18 03:28:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 03:29:06.938525 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:29:06.939195 dv-cinder-818037-10-iscsi devstack@n-api.service[116001]: Sat Dec 18 03:29:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 18 03:29:10.110665 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 18 03:29:10.111217 dv-cinder-818037-10-iscsi devstack@n-api.service[116000]: Sat Dec 18 03:29:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!